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I. INTRODUCTION 



A. THE PROBLEM 

One of the most challenging tasks confronting the 
military services in the All Volunteer Force era is field 
recruiter selection. Effective selection procedures 
increase the likelihood that the services will recruit 
enough people to meet their authorized strength levels, 
their recruiting goals, and their assigned missions. 

Although recruiter selection processes vary by branch of 
service, they share a major flaw: the processes used do not 
provide enough information about whether these people will 
be successful recruiters. Military assignment practices do 
not incorporate sales aptitude testing or profiling of those 
character istics found in successful recruiters. In some 
cases, personnel have been assigned to recruiting duty 
simply because they were available for transfer at the same 
time that a recruiting job became vacant. 

The purpose of this thesis is to identify attributes 
associated with successful recruiters. This is a useful 
area of research that could improve the services' recruiter 
selection procedures and assignment practices. Better 
recruiter /job matches could increase productivity and 
morale, and reduce turnover and related costs resulting from 
moving, training, and replacing recruiters who are not right 



for the job. 
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The services can benefit from a model developed to 
identify personal characteristics that can be used to help 
select, assign and train personnel who are most likely to 
become successful recruiters. As resources continue to grow 
scarce and competition increases for a shrinking supply of 
age-eligible male youth, the military services will need 
recruiters who can work effectively and efficiently if the 
All Volunteer Force is expected to survive. 

B. PURPOSE 

A model will be developed and analyzed to identify which 
attributes make the most valuable contributions to 
successful performance as a recruiter. All services will be 
considered, but the emphasis of the study will be on the 
U. S. Army because data are readily available for its 
recruiting personnel. This thesis will concentrate 
specifically on the personal attributes associated with 
recruiting success of the U. S. Army's Active Guard and 
Reserve (AGR) recruiters. 

At the U. S. Army Recruiting Command (USAREC), success 
of an AGR recruiter is based primarily on achieving the 
assigned recruiter mission, or goal. One objective of this 
thesis is to critique the applicability of existing USAREC 
data for this type of analysis. For example, production 
data may be unsatisfactory because production reflects 
several factors other than a recruiter's individual 
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productivity, such as the potential of the market area, 

management policies, etc. A second objective of this thesis 
is to develop a profile of a successful recruiter. 

C. BACKGROUND 

In 1979 USAREC became responsible to recruit people for 
the U. S. Army Reserve (USAR) in addition to its Active Army 
recruiting mission. This additional mission posed a 
multitude of problems for USAREC in light of the fact that 
the USAR is a geographically limited entity, unlike its 
Active Army counterpart. 

In support of this task, USAREC now has approximately 
1780 field Active Guard and Reserve (AGR) recruiters. This 
is a volunteer force chosen by USAREC from a field of 
solicited, qualified USAR applicants. Carefully selected 
recruiters are needed to ensure that the Army's reserve 
units are filled to authorized strength levels. 

Currently, the selection criteria for AGR recruiters are 
based upon administrative regulations and personal 
interviews or references at the Recruiting Battalion level. 
Some of the criteria contained in administrative regulations 
are described in general below. An AGR recruiter applicant 
must : 

1. Be in paygrade E6 or E7 (waiverable for E5 members if 
insufficient numbers of E6's and E7 ' s apply). 

2. Have a GT score of 110 or higher or ST score of at least 
100 (no waiver). GT, general technical aptitude, is a 
composite test score formed by combining the Verbal 
Comprehension and Arithmetic Reasoning subtests of the 
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Armed Services Vocational Aptitude Battery (ASVAB). 

ST, skilled technical aptitude, is a composite that 
measures ability to read technical manuals, etc. 

3 . Be a high school diploma graduate or have one year of 
college and a GED (no waiver). 

4. Have less than 15 years Active Federal Service. (Member 
must be able to serve at least five years on active duty 
before becoming eligible to receive military retired 
pay. ) 

5. Be at least 21 and not older than 35. 

6. Have no marital, emotional, financial, or major 
medical problems that would hamper performance on 
recruiting duty. 

7. Be interviewed and recommended by recruiting battalion 
personnel (no waiver), and 

8. Meet requirements concerning number of dependents, 
physical standards, past performance, military appearance, 
and others. [Ref. l:p. 15] 

USAREC has 56 recruiting battalions and other commands 
within its organization as depicted by Figure 1.1. Each 
Battalion Commander is responsible for soliciting 

applications and conducting interviews to fill AGR vacancies 
within that battalion. (Most AGR positions within a 
recruiting battalion are recruiter positions, so AGR 
recruiters essentially recruit their own replacements [Ref. 
2]). Even when no vacancies exist within a particular 
battalion, production continues, and the battalion continues 
to select AGR recruiters who will fill other AGR recruiter 
vacancies within USAREC. Figure 1.2 outlines the procedures 
for selection and training of AGR recruiters [Ref l:p. 25]. 
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USAREC hat 5 
Recruiting Brigades. 
(There is no 3rd 
Brigade.) 



There are 9 
Recruiting Battalions 
within the 6th Brigade 
and a total of 56 
within USAREC. 




The San Francisco 
Recruiting Battalion 
has 5 Recruiting 
Comp an i e s . 



I 

L 




Each Recruiting Company 
has several Recruiting 
Stations. There are more 
than 2,000 Recruiting 
Stations within USAREC. 



ReCruL i -fin a 

S 4-A-h'onS 



T— 




Figure 1.1 The U. S. Army Recruiting Command 
Organizational Chart. 
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Figure 1.2 Procedures for Selecting and Training 
AGR Recruiters (Ref. 1) 
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After 



the interview 



completed 



the 



Battalion 



1 s 



Commander selects or rejects the applicant and forwards the 
application to USAREC for administrative review. If 
USAREC's review is favorable, the application is sent to the 
Army Reserve Personnel Center (ARPERCEN). This is where the 
final decision is made. If ARPERCEN's review is favorable, 
orders are issued, and the new recruiter receives a specific 
recruiting assignment. 

Before starting work, the new recruiter must complete 
the Army Recruiter Course at Fort Benjamin Harrison. The 
recruiter remains in an Active Duty for Training (ACDUTRA) 
status until completing the training course. This policy 
provides USAREC and ARPERCEN some flexibility should the new 
recruiter fail the course. Instead of keeping a failed 
recruiter on active duty for three years in a non-recruiting 
job, ACDUTRA can be terminated, and the person can be sent 
home . 

The interview phase is probably the most important part 
of the recruiter selection process, yet this is where 
regulations and guidance appear to allow the most variation. 
Each recruiting battalion has the authority to conduct 
interviews based on its own rules and needs. Thus, it is 
conceivable (and highly likely) that procedures vary among 
battalions. Interview policy and decisions such as number 
of board members (is a one-member board allowed?), 
of f icer /enl isted mix, experience of board members (are 
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members required to have recruiting experience?), length of 

boards, and questions asked vary not only from one battalion 
to another, but also from one board to another within the 
same battalion. A possible result is that different boards 
might make different decisions about the same applicant 
based on the particular experience, judgments, biases, and 
intuition of any one board's members. The subjective nature 
of the interview process could well result in a wide variety 
of decisions, some of which may be more likely to yield 
placement of successful recruiters. 
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II. LITERATURE REVIEW 



All of the military services have studied ways to select 
the best recruiters. This task, grows more critical in the 
All Volunteer Force era as competition grows among the 
services for a shrinking pool of age-eligible males. 



This 


literature review 


will provide 


an overview 


of 


research 


on the selection of 


successful 


recruiters . 


The 


review 


will include discussions of methodologies 


for 



determining factors associated with successful recruiting, 
commonality of resultant factors, problems encountered, and 
will conclude with an assessment of future research needs in 
this area. 

This literature review will address the following 
questions : 

a. What profile of successful recruiters has been 
identified by previous research efforts? 

b. What methods were used to identify these characteristics? 

c. Are the results consistent and valid? 

d. What limitations and problems exist in previous work? 

e. What are the implications for future research? 

While all military services are represented in the lit- 
erature, Air Force studies are outnumbered by a wide margin. 
There appear to be at least two logical reasons. For the 
first few years after the inception of the All Volunteer 
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Force 



the services fielded volunteer recruiter forces. 



That situation has changed. Today, all services except the 
Air Force rely on recruiting forces comprising mainly non- 
volunteers. Another explanation for the Air Force's 
comparatively small body of research on recruiter selection 
is that service's historic recruiting success. The Air 
Force has been the number one service choice among potential 
enlistees for decades, and the service has met its 
recruiting goals with no apparent difficulty. Thus, the Air 
Force has not had as much of a need to examine the recruiter 
selection issue. 

Although various methods have been used to conduct 
research in recruiter selection, most researchers used 
paper-and-pencil test batteries in their attempts to 
identify characteristics of successful recruiters and 
predict recruiter performance. Other researchers used 
biographical information, structured and unstructured 
interviews, job analysis, assessment centers, and other 
methods . 

Although most older studies reviewed presented 
reasonable hypotheses, sound analysis, and interesting 
conclusions, results in many cases were disappointing. In 
several studies, few findings were statistically 
significant. In others, findings that were significant had 
dubious meaning because they were not cross-validated. In 
still others, when cross-validation was attempted, original 

results could not be duplicated. 
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Some researchers shared common problems in their work. 

that may help to explain their disappointing results. The 
most common was dubbed the "criterion problem": measuring 
recruiter performance in a reliable and valid manner [Ref. 
3:p. 16]. Researchers have used supervisory ratings, school 
performance, percent of quota achieved, and total number of 
recruits enlisted as performance measures, among others. 
Yet, supervisory ratings are often unreliable and of 
questionable validity [Ref. 4 : p . 1]. Even with the best of 
intentions, supervisors can be influenced by characteristics 
unrelated to job effectiveness. This can lead to 
evaluations based on reputation rather than performance. 

For example, as one study explained, a recruiter might 
be rated high because he is likable and has good military 
bearing and a good production record. Yet, the recruiter's 
successful production might be the result of having been 
assigned to a fertile recruiting territory. [Ref. 5:p. 14] 
Graduates of recruiting school may perform differently in 
the field than they do in training. Finally, using 
recruiter production figures that do not account for 
"opportunity bias," the relative ease or difficulty in 
obtaining enlistments in a particular area, fails to examine 
variations in productivity due simply to differences in 
individual recruiters [Ref. 5:p. 16]. 
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Another problem that plagued some research was a lack of 

information about the recruiter's job. Several studies 
attempted to correct this by identifying tasks recruiters 
perform, and later research benefitted from information 
collected through job analysis. 

The selection environment, while not exactly a 
"problem, " has become a necessary consideration in recruiter 
selection. Since most active duty recruiters are now 
selected involuntarily, recent research attempted to 
identify reliable recruiter selection methods that would not 
be vulnerable to compromise or "faking," as test batteries 
are. (The number of recruiters selected involuntarily 
varies by branch of service. The Air Force is currently the 
only service whose active duty recruiters are all 
volunteers. Selection procedures also vary within a 
service. For example, nearly all of the Army's Active Guard 
and Reserve (AGR) recruiters are volunteers, yet most 
recruiters who enlist people into the Regular Army are non- 
volunteers.) Researchers in favor of more passive methods 
advocate the use of demographic, biographical data the 
services maintain routinely in various data banks. 

The next section discusses relevant studies organized by 
research method. Unless particularly relevant, older 
studies are discussed fairly briefly. More recent work is 
discussed in greater detail. 
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A. INTERVIEWS 



1 . Borman, Hough, and Dunnette 

A 1976 report published by NPRDC describes the 
efforts of Borman, Hough, and Dunnette to develop 
behavioral ly-based rating scales to evaluate the performance 
of Navy recruiters. During two days of workshops, more than 
800 critical incidents (examples of recruiter performance) 
describing effective and ineffective recruiting performance 
were obtained from field recruiters from all Navy Recruiting 
Areas. Another 135 performance examples were solicited from 
Navy recruits during interviews at boot camp. Researchers 
believed that an extensive analysis of the recruiter job 
would be required before any further research on recruiter 
selection could be accomplished. To become familiar with 
the recruiter job, the researchers went to those who knew 
the job: recruiters, supervisors, and recruits. NPRDC's 
1976 study was the springboard for three additional studies 
conducted over the past ten years. These studies are 
discussed in the next section. [Ref. 6] 

2 . Borman, Toquam, and Rosse 

A 1977 Army Research Institute study [Ref. 7] 
hypothesized that a reason why paper-and-pencil predictors 
of Army recruiter effectiveness may have met with such 
little success was that not enough was known about the 
performance requirements of the recruiter job. This study 
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focused on discovering these performance requirements by 

attempting to define the underlying task dimensions 
associated with Army recruiter and guidance counselor jobs. 

The first step was to revise an existing Department 
of the Army task list that described the occupational 
designator 00E Military Occupational Specialty (MOS). Army 
recruiters and guidance counselors share this MOS because 
their jobs are similar. The recruiter's job is to get 
people to enlist. The guidance counselor's task is to 
convince them to reenlist. The Army maintains lists of tasks 
performed in most MOSs . With the assistance of Army 
recruiting personnel, the authors shortened the existing 
task list, or inventory, by removing outdated items and 
combining others that were similar. 

After a pilot test, the revised task inventory was 
administered to 101 field recruiters, guidance counselors, 
and supervisors across all five recruiting regions. These 
101 people, who were familiar with the recruiter and 
guidance counselor jobs, sorted the tasks into groups, or 
dimensions, according to the tasks' perceived similarity 
with respect to job function. Participants worked on their 
own, each sorting task statements into categories. 

Before analyzing the data, researchers tested the 
extent of agreement in solutions by dividing participants 
into various subgroups: recruiter and guidance counselor 
groups. District Recruiting Command (DRC) subgroups, etc. 
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was 



Once consistency in responses across subgroups 
established, the data were collapsed across all subjects and 
analyzed. The two types of analyses performed were 

multidimensional scaling (HDS) and a Ward and Hook 
clustering procedure. 

Results indicated that people in the different DRCs 
agreed substantially among themselves about the pattern of 
similarities among tasks. Guidance counselors and 
recruiters agreed closely, and supervisory personnel saw 
much the same pattern of task similarities as those they 
supervised. Since no serious disagreements in responses 
existed, the solutions were collapsed across the entire 
sample, and a summary list of task dimensions was formed 
(see Table 1). This composite list contained four broad 
dimensions defining general task areas associated with the 
recruiter's and guidance counselor's role in the Army 
recruitment process. 

Borman et al., believed these dimensions would be 
useful in developing selection procedures for potential Army 
recruiters. They believed the content of the dimensions 
would suggest the types of personal characteristics and 
attributes necessary for effective recruiter performance. 
Then, paper-and-pencil measures of these attributes could be 
chosen or developed as indicators of potential for top-level 
performance in Army recruiting work. The authors also 

suggested that the dimensions could serve as performance 
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TABLE 1 



Composite List of Task. Dimensions 



I. Prospecting Activities 

Identifying and contacting qualified prospects. 

using existing name sources to generate lists of 
prospects 

contacting prospects 

dealing with centers of influence and other persons 
in the schools and in the community for the purpose 
of gathering prospect names 
obtaining referrals 



II. Publicizing the Army 

Building a positive Army image in the community by setting a 
good example and by providing favorable publicity for the 
Army and Army enlisted programs. 

conducting Army publicity programs in the schools or 
in the community 

working with the news or other media to obtain 
favorable publicity for the Army 
performing community services and working with 
community groups to enhance the Army's image 
preparing and delivering presentations about the Army 
to civic organizations, at career counseling sessions, 
or at recruiting seminars 

III. Selling the Army 

Getting individuals to join the Army by counseling them, 
explaining Army benefits and opportunities to them, and 
presenting the advantages of Army- life. 

describing aspects of Army life, benefits, and 
opportunities to prospects 

conducting interviewing or counseling sessions with 
prospects to sell them on the Army 

answering questions about the Army and about enlist- 
ment; overcoming objections to joining the Army 
service 

sizing up individual prospects and tailoring the inter- 
view to help sell Army 
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TABLE 1 



Composite List of Task Dimensions (Continued) 



IV. Administrative Activities 

Working with recruiting reports, records, statistics, etc., 
and organizing recruiting activities. 

preparing, maintaining, and reviewing enlistment 
reports 

planning recruiting activities: performing market 

research, zoning recruiting areas, etc. 
maintaining recruiting statistics and records 
maintaining recruiting publications 



(Ref. 7] 
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rating scales in future selection research intended to 

ensure that selection procedures chosen were, in fact, 
validly identifying persons with good potential for Army 
recruiting. (This study did not identify personal 
characteristics and attributes of successful Army 
recruiters; however, Borman is currently working on a 
project to develop performance-based rating scales for Army 
recruiters similar to work he did for the Navy in 1976.) 

3 . Graham, Brown, King, White, and Wood 

An Army Research Institute study describes 
structured interviews conducted with 79 Army recruiters to 
obtain information on the nature of recruiting duty (Ref. 
8]. The sample was selected to represent recruiters with 
high, medium and low records of success, in terms of 
percentage of quota achieved. Information collected from 
the interviews was used to develop hypotheses on the 
personal characteristics and job behaviors associated with 
recruiter success. These hypotheses would be evaluated more 
rigorously in later research. 

Interviews solicited the following types of 
information from recruiters: background characteristics, 
suggestions about recruiter training, the value of various 
prospecting and selling techniques, workload, attitudes 
toward the job, personality characteristics that might be 
related to recruiter effectiveness, and descriptions of 
successful and unsuccessful recruiters they knew. Responses 
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were coded, categorised, and analyzed to show: (1) personal 

characteristics and job behaviors related to recruiter 
production records and (2) personal characteristics and job 
behaviors attributed (by the respondents) to successful and 
unsuccessful recruiters they knew. 

The criterion used as a productivity measure was the 
percentage of the total non-prior service (NPS) quota 
achieved in a six-month period. The authors realized the 
limitations of this measure, but felt it was the best 
obtainable within their time and money constraints. 

Recruiters were placed into criterion groups of 
high, medium and low producers based on production data. 
Interview responses were coded into broad categories. 
Relationships between interviewee responses and their 

production records were explored in two ways: 

a. Comparison of high and low producers (chi square 
test). The authors hypothesized that high and low 
producers' scores would differ significantly in many 
categories . 

b. Correlations between presence in a category and 
production records. Each recruiter was assigned a 
score of 0 or 1 based on whether or not he was described 
by a response within that category. Category scores 
were correlated with the production criterion to 
determine relationships between response categories and 
the criterion. 

The authors warned that this pilot study used a 
small sample that may not have been representative of 
recruiters in general, and that their findings should be 
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regarded as indications of possible 
relationships whose validity would need to be 
future research. 



significant 
assessed by 



Few of the characteristics in the self-description 
data were significantly related to production records. Some 
of the study's findings are listed here. 

a. Attitudes Toward the Job - "Likes independence" 
correlated significantly and negatively with job 
success (r = -.24), suggesting that high producers 
were less likely than low producers to cite 
"independence" as a source of job satisfaction. 
Recruiters who commented on their dislike of 
"long hours," "the frustrating nature of the job," 
etc., tended to be more productive than those who 
did not make those comments. 



b. Prospecting Techniques - According to successful 

recruiters, this is one of the most important compo- 
nents of the job. The objective is to bring the 
recruiter into direct personal contact with 
potential enlistees. Successful recruiters emphasized 
that they spent many hours daily in prospecting 
activities. Two response categories, "Uses system- 
atic approach" and "Uses Pre-induction physical 
cards, mail-outs, etc.," were statistically 
significant . 



c. Selling Techniques - The ability to motivate a 
person to enlist is believed to be an important 
characteristic of the successful recruiter, yet 
none of the selling techniques mentioned by recruiters 
interviewed were significant. 



d. Communications Skills - A highly successful 
recruiter must be able to communicate effectively. 
One category, "Has difficulty communicating 
effectively" correlated negatively and significantly 
with the production criterion. Thus, high producers 
admitted having communication problems less often 
than low producers. 

e. Industriousness - The pilot study did not reveal 
much information in support of the idea that hard 
work is essential for successful recruiters. Although 
several recruiters described themselves as "motivated" 
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or as "self-starters," these responses were not 
significantly related to high or low production. 

Only one response category, "Keeps informed on everything 
relevant to job," differentiated significantly between 
high and low producers. 

f. Miscellaneous Personality Traits - "Empathetic" 

correlated negatively and significantly with the 
production criterion. The authors suggested that 
empathy seemed to be a highly valuable character is t ic 
for a recruiter, yet it correlated negatively 
with success. McMurry suggested that high empathy 
may be a handicap to a salesperson unless it is 
accompanied by a strong ego drive or will to win 
[Ref. 8 : p . 211. 

During the interviews, each recruiter was asked to 
think of one successful and one unsuccessful recruiter he 



knew and answer questions about the two recruiters' work 
attitudes, job skills, personality traits, etc. 

The authors believed many recruiters' responses were 
actually elements in a stereotype of the good recruiter, 
which they may have acquired in training or elsewhere, and 
not based on actual observations of the nominee. They were 



not surprised by the data and believed this peer nomination 



data should be regarded as recruiters' opinions of what it 
takes to be a good recruiter rather than descriptions of 
good and poor recruiters. The recruiters' conceptions of 
the successful and unsuccessful recruiter are included in 



Table 2 for information. (Note: Data on successful and 

unsuccessful recruiter nominees were provided by the same 

As a result, the chi-square statistic 
the significance of the difference between the 



respondents . 
exaggerates 
two groups . ) 
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TABLE 2 



Characteristics Differentiating Successful and 
Unsuccessful Recruiters: Peer Nomination Data 



Nominees 
( in Percent ) 



Category 3 ' 



Successful Unsuccessful 
UL = 79) OL-* _7_Q ) 



Motivations For Becoming a Recruiter 

Dislike for present assignment 9 43 



Prospecting Techniques 



Uses systematic approach 


52 


1 


Stresses person-to-person contact 


62 


19 


Uses high school CIs 


31 


2 


Uses other CIs 


9 


0 


Uses PIP cards, mail-outs, etc. 


24 


5 


Becomes involved in community 


35 


6 


Passively waits for prospects to walk in 


2 


49 


Emphasizes peripheral duties 


1 


32 


Emphasizes outside interests 


1 


14 



Selling Techniques 

Uses miscellaneous effective sales 

techniques 24 4 

Uses miscellaneous ineffective sales 

techniques 0 11 



Communication Skills 

Able to communicate effectively 39 14 

Has difficulty in communicating 

effectively 0 18 



Job Attitudes 



Likes 


the 


work 


86 


20 


Likes 


the 


challenge of the Job 


17 


0 


Disl ikes 


the high pressure 


19 


34 
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TABLE 2 



Characteristics Differentiating Successful and 
Unsuccessful Recruiters! Peer Nomination Data (Continued) 



Nominees 
(in Percent) 



Ca.tsaQCY a 



Successful Unsuccessful 

(II .£—7 9 ) ( II ? 79) 



Job Attitudes (Continued) 

Dislikes other features 3 25 

Wants another type of duty 10 53 



Industrious ness 



Has high achievement motivation 18 
Has low achievement motivation 4 
Is very conscientious 35 
Is careless about details 1 
Seeks ways to improve 8 
Keeps informed on everything related 

to job 18 



3 

47 

3 
19 

0 

4 



Miscellaneous Personality Traits 



Friendly, easygoing 
Outgoing 
Sympathetic 
Stable 

Happy, humorous 
Light-hearted 
Sincere 
Withdrawn 

Shy, self-conscious 
Lacks self-discipline 
Has family problems 
Inconsistent 
Hostile 

Emotionally immature 
Resentful, rebellious 



53 
44 
20 
13 
1 1 
10 
10 
1 
1 
1 
1 
0 
0 
0 
0 



4 

0 

0 

0 

0 

0 

1 

17 

17 

14 

13 

14 
13 
10 
10 



a A 1 1 categories included in this table differentiated the two 
groups of nominees at the .05 level of significance or beyond, 
using the chi-square test. 

(Ref. 8) 
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(The more general the characteristic and the more congruent 

with stereotypes of the good and bad recruiter, the more 
frequently it was mentioned.) 

Some questions in the interview asked the recruiters 
for their opinions about recruiter selection. A summary of 
responses the recruiters mentioned most often and the 
percentage of those responding appears in Table 3. 

4 . Hirabavashi and Hersch 

A recent effort attempted to document 
characteristics of excellent Navy Recruiting Districts [Ref. 

91. The authors visited and interviewed key individuals 
assigned to these and other Navy recruiting activities. 
Interviews were representative of the Navy Recruiting 
Command: current and previous Recruiting Command commanders, 
commanding officers, executive officers, department heads, 
recruiters, recruiters' supervisors, trainers, and more. 
Based on the results of the interviews, the following list 
summarizes the characteristics of successful recruiters. 
Successful Navy Recruiters: 

- are movers, shakers, and salesmen 

- are hungry for success and/or promotion 

- are aggressive, want responsibility, and want to excel 

- possess outstanding communications skills, a fundamental 
knowledge of recruiting, and an inherent skill to deal 
with numbers, sales, and the public 

- are ambitious, extroverted, and like to meet and talk t< 
people 

- are positive, cheerful, enthusiastic, and self-motivated. 
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TABLE 3 

Recruiters' Opinions Regarding Recruiter Selection 



Response Percentage 

Should be able to talk to people 49 

Should have well-groomed appearance 33 

Should want to do the job 30 

Screen for quality of past performance 28 

Should have "substantial" length of service 24 

Should enjoy working with people 20 

Should be stable in finances 16 

Should have sales experience 13 

Should be adaptable 3 

Tell then what recruiting is really like 11 

Provide two months of OJT 1 1 

Should be outgoing 10 

(Ref . 8) 
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B. TEST BATTERIES 

1 . woiiacK-and Kipnis 

These authors developed a test battery to determine 
its possible usefulness in Navy recruiter selection (Ref. 
10]. The battery's thirteen tests and inventories measured 
fluency o f ^express ion, knowledge of the Navy, interest in 
recruiting activities, and general aptitude. 

The study used commanding officers' nominations of 
effective and ineffective recruiters as the criterion 
measure of performance. Items that differentiated between 
effective and ineffective recruiting beyond the .20 
confidence level were retained for cross-validation. 

Although few of the battery's items and scales 
cross-validated significantly, the study's results suggested 
that inventories showed promise as indicators of recruiter 
effectiveness. Borman suggested that the poor cross- 
validation results may have occurred because raters made 
their evaluations of recruiters based on reputation instead 
of performance or because many of the individual differences 
that predict recruiter success were not included in the 
battery. (Ref. 3:p. 4]. 

2 . Massev and Mullins 

Only one Air Force study appeared in the literature 
reviewed. Massey and Mullins (1966) developed an eight- 
inventory battery to measure qualities such as empathy. 
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surgency (friendliness and sociability), and perseverance 
all hypothesized to be desirable in recruiters (Ref. 11]. 



Predictor variables were correlated with school 
success and supervisor field ratings. Results after cross- 
validation indicated that the battery would be useful only 
marginally in predicting school performance and not at all 
in predicting field ratings. The authors believed the 
supervisor rating criterion had caused the poor results, 
suggesting that it was contaminated by several rater errors 
such as "halo" and "leniency" effects. They advocated the 
development of a more reliable and valid measure of 
recruiter effectiveness. 

3. Krug 

In this study, a personality test is developed and 
administered to officer and enlisted Navy recruiters to 
determine its usefulness in predicting sales ability [Ref. 
12]. The test, the 16PF-m, was a variation of the 16PF, a 
highly regarded personality inventory widely used by 
business and industry in sales selection (Ref. 13:p. 221. 

In addition to the 1967 version of the 16PF 
questionnaire, the 16PF-m included a supplement designed to 
measure motivational distortion (a lie scale) and strength 
of motivation to succeed as a recruiter, and seven 
biographical items: years of service, age, sex, marital 
status, number of dependents, years of formal education, and 
population of subject's Home of Record. 
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Commanding officers' nominations of recruiters from 

the top and bottom fifty percent of those on recruiting duty 
at the time were used as the criterion measure of 
performance. Stepwise multiple regression resulted in a 
multiple regression coefficient of .40 (p < .01). In cross- 
validation, the multiple regression coefficient was .25 (p < 
.05). Results indicated that the typical effective Navy 
recruiter was married, had more years of formal education, 
and tended to be warm, outgoing, dominant, aggressive, and 
self-assured, with relatively conservative political views. 

The Navy Recruiting Command used this battery to 
screen people for recruiting assignments for approximately 
four years between 1972 and 1976. Active duty Navy 
personnel took the test if they were being considered for a 
recruiting assignment. Those who scored below thirty-five 
were considered unqualified for recruiting duty. (A score 
of sixty-five was recommended by the study team and was 
predicted to be seventy-two percent accurate, but the Navy 
Recruiting Command chose to use a score of thirty-five.) 
Use of the test was discontinued when Navy Recruiting 
Command and the Chief of Naval Personnel (Pers 502) agreed 
it did not predict sales ability effectively [Ref. 13:p. 
24] . 

In his 1976 study, Arima stated the 16PF had little 
or doubtful utility in the selection process due to the 
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absence of a reliable and valid criterion [Ref. 14]. He 
called for job analysis and behaviorally-anchored rating 
scales . 

The development of a recruiter selection procedure must 
be preceded by a thorough analysis of the position that 
will show the functions performed and the relative 
importance of the functions. It will also be necessary 
to obtain knowledge as to the types of behavior that are 
necessary to carry out these functions successfully 
and the types of behavior that are detrimental. There 
is nothing new in this approach . . . developing 

behaviorally anchored rating scales could provide the 
desired list of behaviors. Knowledge of the job . . . 

should provide the material to develop a recruiter 
selection procedure. [Ref. 14:p. 129]. 

4 . Larr lva 



The 16PF-m was applied to a sample of Marine Corps 
recruiters in a concurrent validity study in 1975 [Ref. 15]. 
Annual non-prior service accessions were used as the 
criterion measure of performance. The test did not predict 
well, and Larriva suspected the criterion he used had caused 
the problem. He experimented with several performance 
indices, examined predictor criterion relationships, and 
chose the index that resulted in the most valid multiple 
correlation coefficient. This index separated urban and 
rural recruiters and corrected for geographic differences in 
relative performance of recruiters. Cross-validation 
suggested the 16PF-m might be useful in screening for the 
Marine Corps recruiter job [Ref. 3:p. 8]. 

Borman et al. objected to Larriva's method of 
criteria selection, saying that a more acceptable (and 
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justifiable) method would have been to define a precise 
criterion first and then select a measure that would provide 
relevant and reliable measurement of the criterion without 
regard to the predictors [Ref. 3:p. 9]. 

5 . Abrahams, Neumann, and Rimland 

In 1973, the Strong Vocational Interest Blank (SVIB) 
was used to develop a Recruiter Interest Scale (RIS) for use 
in selecting Navy recruiters. Items that differentiated 
between the most and least effective recruiters, based on 
commanding officers' nominations, comprised the RIS-1, which 
was used for cross-validation. The top quartile (highest 
RIS scores) contained three times as many effective 
recruiters as did the bottom quartile. The bottom quartile 
had three times as many ineffective recruiters as the top 
quartile. Although the authors stressed that a better 
criterion of recruiter effectiveness was needed and that 
other recruiter performance factors should be considered in 
future validity research, their study suggested that 
vocational interests might successfully predict recruiter 
effectiveness. [Ref. 16] 

6 . Graf and Brower 

In 1976, these authors also had some success with a 
version of the Navy RIS modified for Marine Corps 
recruiters. Although the Marine Corps Recruiter Interest 
Scale (MCRIS) resulted in a higher validity coefficient than 
the Navy scale for the Marine Corps sample, the MCRIS was 
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not cross-validated, which made direct comparisons 

impossible. Although the authors had used recruiting 
officers' nominations of above-average, average, and below- 
average recruiters as their criterion measure, they called 
for a more rel iable method of measuring recruiter perfor- 
mance. [Ref. 17] 

7 . Borman, Hough, and Dunnette 

The most extensive work found in this area is a test 
battery developed by the Navy Personnel Research and 
Development Center (NPRDC). This work has evolved through 
four studies over the past ten years. 

NPRDC's work began with the development of 
behav ioral ly-based rating scales which attempted to identify 
better performance criteria than had been developed in the 
past for measuring recruiter effectiveness. Researchers 
believed that acquiring valid information about recruiter 
effectiveness meant that a thorough job analysis and 
criterion development effort would have to be accomplished. 
Their first study, published in 1976, identified more than 
800 critical incidents describing different facets of 
effective and ineffective recruiter performance. The 
study's suggested predictors of Navy recruiter effectiveness 
appear in Table 4. [Ref. 6] 

The second phase of NPRDC's research involved 
development and validation of an inventory battery to 
predict Navy and Marine Corps recruiter performance. Their 
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Suggested Predictors of Navy Recruiter Effectiveness 
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review of the literature provided candidate predictors that 
might be good indicators of future recruiter effectiveness, 
including vocational interests, interest inventories, 
background or biographical variables, and personality or 
trait measures. Recruiter abilities appeared unrelated to 
recruiter performance. Intelligence and other types of 
ability measures generally failed to predict recruiter 
success. [Ref. 3] 

Based partly on their literature review and the 
results of their rating scales study, NPRDC developed a 
trial predictor battery that included several personality, 
vocational interest, and biographical items and scales. 
Battery scores were correlated with performance scores 
developed from supervisory, peer, and self ratings and from 
six months of adjusted production data. (Standard scores 
were developed for each recruiter for each month by 
standardizing each month's production data within each Navy 
Recruiting District (NRD). This was an attempt to account 
for differences in recruiting opportunity across geo- 
graphical locations.) 

NPRDC 's third study was designed to expand and 
refine the original test battery and determine its validity 
in predicting recruiter performance. The revised battery 
was analyzed to determine the precision of new items in 
measuring desired constructs and whether they had improved 
the validity of the original test battery. Composites of 
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the added items enhanced the validity of the old battery's 

constructs in about half the cases. Scales derived from the 
constructs validly predicted recruiter effectiveness. [Ref. 
18] 

NPRDC ' s final Special Assignment Battery consisted 
of three parts: the Strong-Campbell Interest Inventory, a 
self-description inventory, and a background questionnaire. 
Recruiter potential was measured through a selection 
composite composed of four subscales: selling skills, human 
relations skills, organizing skills, and overall 
performance. Scores on each of these four "keys" were 
correlated with each recruiter's production data. Table 5 
displays validity figures for predicting production. Three 
of four figures are statistically significant. 

When the four separate scores were summed into a 
composite, the correlation coefficient between the composite 
and production was .27. Figure 2.1 depicts the practical 
significance of this relationship. Sixty-six percent of the 
recruiters scoring in the top 20 percent were in the upper 
50 percent in production, compared to 34 percent of those 
scoring in the lowest 20 percent. 

Several personality constructs correlated highly 
with various aspects of recruiter effectiveness. "Making a 
good impression" and "Enjoying being the center of 
attention" correlated highest with selling skills. 
"Spontaneity, impulsivity" and "Ambitious, working hard" 



42 



TABLE 5 



Validity of Final Keys for Predicting Production 

(M = 194) 



Predictor Key 


Correlation with 
Production 


Selling Skills 


.22* 


Hunan Relations Skills 


.23* 


Organizing Skill 


.13 


Overall Performance 


.26* 


. 01 . 




(Ref. 18) 





43 




44 



Figure 2.1 Percent Successful Recruiters Expected Where Upper 
50 Percent are Considered Successful. (Ref* 18) 





correlated highest with the human relations skills category, 
while "Unhappy, lack of confidence" related negatively to 
human relations effectiveness. "Order, planning ahead" 
related well to organizing skills, and "Leading and 
influencing others" was the construct that correlated most 
highly in the overall performance category. The vocational 
interest constructs that correlated highly with performance 
criteria were interests in extroverted, dominant, social, 
and leadership activities and occupations, interests in 
sports and competitive activities, and interests in law and 
political activities. 

The fourth phase of NPRDC's work, published in 1985, 
strongly confirmed the findings of the earlier studies. In 
concurrent and predictive studies. Marine Corps recruiters 
whose scores were in the top 20 percent obtained 27 and 40 
percent more recruits, respectively, than recruiters who 
scored in the lowest 20 percent. CRef. 191 
8 . Brown, Wood, and Harris 

An Army Research Institute study, published in 1978, 
had two objectives: (1) develop a valid criterion of 

recruiter effectiveness and (2) develop a test battery to 
identify those most likely to succeed as recruiters [Ref. 
51 . 



The authors believed production scores were not a 
useful criterion because they were contaminated by 
"opportunity bias" caused by characteristics that influenced 



45 



the "fertility" of a recruiting territory but were outside 
the recruiter's control. 

Army researchers and recruiters identified 15 
factors that might cause opportunity bias, such as the 
unemployment rate in the territory, average number of 
enlistments per recruiter in the recruiter's District 
Recruiting Command (DRC), amount of recruiting experience, 
etc. A sample of 500 recruiters was chosen randomly, 100 
from each of five Army Regional Recruiting Commands nation- 
wide. Six months' production figures were provided for each 
recruiter . 

Stepwise multiple regression was used to predict the 
theoretical yield of a recruiter's territory using 12 of the 
15 territorial factors in the equation (three census 
variables were excluded). The three best predictors were 
"Average production per recruiter in subject's DRC," 
accounting for 48 percent of the variance in production 
scores; "Average market share for station zone"; and 
"Proportion of the zone that is suburban." 

These three predictors, which accounted for 51 
percent of the variance in production scores, were used to 
predict production scores for each recruiter. Benchmark 
Achievement Scores (BAS) were computed by dividing total 
production by predicted production and multiplying by 100. 
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The BAS were thought of as unbiased production scores, 

corrected for the effects of three important territorial 
factors . 



The authors suggested that another production 
measure, the Simple Achievement Score (SAS), might be just 
as useful as the BAS. Since "Average Production Per 
Recruiter in Subject's DRC" explained the most variance in 
the regression equation, a score based on the individual's 
performance compared to that average would be easier to 
compute. (SAS correlated highly with BAS (r = .96), so the 
two scores were practically equivalent.) 

The second objective of this study was to develop a 
recruiter selection battery. The battery was developed 
based on the pilot study by Graham et al . [Ref. 8] involving 
interviews with 79 Army recruiters with high, medium, and 
low records of success. Personnel from Army Recruiting 
Headquarters were also consulted about traits necessary for 
recruiter success. 

The selection battery consisted of 12 paper-and- 
pencil inventories and one verbal performance test. Below 
is a list of the measures included in the battery. 

a. Verbal Fluency . Recruiters were asked to make a 

sales pitch to a prospective enlistee about the benefits 
of Army life. Presentations were scored by computing 
the ratio of the number of words spoken in two minutes 
to the number of "ahs" spoken. The authors hypothesized 
that an effective recruiter must be able to talk easily 
in a variety of social situations, and they wanted 
to measure verbal fluency orally, in the most 
realistic situation possible. 
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b. Sociability Measures. Four inventories were used 

to measure a recruiter's sociability and affiliative 
tendency. The authors hypothesized that sociability 
was important since a recruiter must spend so much 
time interacting with people (who often are strangers). 

c. Achievement Motivation . Three inventories were 
used to measure the tendency to work hard to achieve 
self-appointed goals. This was hypothesized to be a 
positive characteristic of a good recruiter. 

d. Empathy Measures . Four instruments were used to 
measure the ability to understand the point of view 
of others and the drive to win or complete a sale. 

The authors believed empathy alone is not enough. 

The successful recruiter goes on to close the sale. 

e. Rejection Tolerance Measure . One inventory was 
used to measure tolerance to rejection, rebuffs, and 
insults. The hypothesis was that the successful 
recruiter has a higher tolerance for rejection than 
does the less successful recruiter. 

f. Responsibility and Maturity Measures . Three 
instruments collected information about a recruiter's 
ability to manage his personal, financial, and official 
duties. Since recruiters spend the bulk of their duty 
time working without supervision, and since they 
represent their branch of service to the general public, 
they are expected to manage their personal, financial, 
and official duties with discretion. 

When the time came to administer the battery, the 
criterion development project mentioned earlier (BAS and 
SAS) was not yet completed. Instead, the authors created a 
Composite Supervisory Rating procedure to select highly 
successful and very unsuccessful recruiters. Recruiters 
were nominated by supervisors. The best were used in the 
High Criterion Group, and the poorest were used in the Low 
Criterion Group. The battery was administered, and 
information on each recruiter's race, religion, and aptitude 
scores was obtained from Army personnel files. 
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None of the personality measures or aptitude scares 



differentiated significantly between the two groups. The 
verbal performance test and 22 other items differentiated 
significantly (p < .10). These items pertained to work 
habits, style of handling finances and debts, educational 
background, and reactions to challenging or stressful 
situations . 

The authors suggested that because recruiters are a 
relatively homogeneous group required to meet several 
minimum qualifications (age, rank, GCT scores), and because 
of their length of time in service (mean was 14 years), the 
recruiters may have had similar attitudes and opinions, 
which would have limited the variance in attitude, personal 
preference, and personality inventory scores. (The few 
items that did discriminate were mostly from the Background 
Information Form and Personnel Questionnaire, instruments 
dealing mainly with matters of fact rather than attitude.) 

In his review of this study, however, Borman 
suggested the low relationships between predictors and the 
criterion could also have been the result of the criterion 
measure used. Had the authors been able to use the Simple 
Achievement Score (SAS) they had suggested, rather than 
supervisor nominations, higher validities might have 
resulted. [Ref. 3:p. 13]. 
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Although 20 variables were significant in this 

study, they were not cross-validated. Nonetheless, the 
authors were encouraged about the possible utility of the 
variables in future work. 

C. ASSESSMENT CENTERS 
1 . Borman et al . 

In 1982 the assessment center concept was added to 
the Army recruiter training process. Assessment centers are 
believed to be particularly valuable for selection of 
individuals for sales positions, and military recruiters are 
essentially salespeople. Since assessment centers usually 
involve parts of an actual job under observation, they are 
equally adaptable for training for these jobs. [Ref. 20] 

Borman investigated the use of assessment centers to 
select Army recruiters and decided the approach had promise 
[Ref. 21]. Under this approach, trained observers rated 
potential recruiters' performance in several different 
situational exercises that simulated aspects of the 
recruiter job. Assessors were interested in personal 
characteristics such as persuasiveness, sociability, 
flexibility, and practical judgment. 

Results showed that this method could successfully 
predict recruiter school performance even with a sample of 
recruiters that had been pre-screened by a selection panel. 
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based on the 



The assessment center concept is 
assumption that people being rated want the job. Yet, 
requirements for recruiters have grown, forcing the Army to 
assign most of its recruiters involuntarily. This made 
infeasible the use of assessment center ratings to select 
recruiters. The Army's problem had become one of motivation 
and development rather than selection. So, the purpose of 
the assessment center shifted. 

Assessment exercises were cut dramatically. Instead 
of being used for selection, ratings given in a revised 
Recruiter Development Center were designed to give recruiter 
trainees a realistic job preview and the positive feedback, 
they needed to enhance their motivation. 

2 . Weltin et al . 

This study related the ratings of the original 
assessment center and a subsequent development center sample 
to the number of contracts the new recruiter produced in the 
first year on the job. The criterion measure accounted for 
geographic differences in sales potential among recruiting 
battalions. [Ref. 22] Previous work by Brown et al . [Ref. 
5] showed that production per recruiter in the subject's 
battalion (district) accounted for 48 percent of the 
variance in production scores. Some Army recruiting 
battalions have better sales markets than others. To 
control for these geographic differences in sales potential, 
Weltin et al., partialed the number of contracts per 
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recruiter achieved in his battalion of assignment from each 



recruiter's performance score. While Borman's work related 
assessment center ratings to training performance, this 
study evaluated the usefulness of the ratings for predicting 
j ob performance as a field recruiter. 

The assessment center sample included 41 of 57 
soldiers who had taken the original battery of assessment 
center exercises in 1981 and completed the training course. 
Each individual had been rated by trained assessors in 
exercises that included cold calls, interviews, a speech, 
and the in-basket (work prioritization). Other predictors 
included training school grades (written test scores and 
instructor ratings of telephone and interviewing 
techniques), and scores on the following: a test battery 
developed to select Navy recruiters, an experimental Army 
test battery, and the Gordon Personal Profile and Inventory. 

The development center sample included 970 
recruiters who were rated in the center, completed training, 
and had at least one contract their first year on the job. 
Assessors were not trained. Essentially the same exercises 
were used as in the assessment center. No personality or 
interest batteries were used. Written training grades were 
available, but instructor ratings on telephone and 
interviewing techniques were not. 

Results indicated that the assessment center ratings 
had low correlations with job performance; however, in the 
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development center sample 



the cold cal 1 / interview and 



speech exercises were significant. Training grades were not 
predictive in either sample. The personality and interest 
test scores significantly predicted job performance. Navy 
test scores (human relations, selling, and organizing 
subscales), the ARI test, and two scales of the Gordon 
Personal Profile and Inventory showed moderate relationships 
with job performance. 

Stepwise regression performed on the development 
center sample indicated that productivity of the recruiter's 
battalion was the single most important factor in predicting 
job performance. Ratings on the speech exercise and AFQT 
scores predicted approximately two percent additional 
var iance . 

The authors suggested that the sizes of individual 
correlations should be interpreted cautiously due to the 
small size of the assessment center sample, differences in 
rater training, and Assessment Center changes. They also 
noted that the assessment center ratings showed some utility 
as predictors of recruiter performance on the job. 

D. BIOGRAPHIC/DEMOGRAPHIC VARIABLES 
1 . Bennett and Haber 

In 1973, these authors investigated various factors 
that influence the productivity of Marine Corps recruiters 
[Ref. 23]. They used multiple regression to analyze the 
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relative importance of sixteen variables on gross 

productivity (average number of recruits enlisted per 
month). Variables were divided into three categories. 
Selection variables included General Comprehension Test 
scores, age, race, level of education, number of dependents, 
previous service as a career planner or drill instructor, 
method of assignment to recruiting duty (volunteer or 
assigned), and opinion about whether recruiting duty was a 
financial hardship. Deployment variables included whether 
recruiters were assigned to their home states, distance from 
home state, type of area assigned to (urban, suburban, or 
rural), number of times assigned, hours per week spent on 
recruiting, and percentage of time spent out of the office 
recruiting. Evaluation variables included number of months 
on current tour of duty and percentile rank in Marine Corps 
Recruiter Class. 

The authors noted that gross productivity was 
determined by regional differences as well as differences in 
individual recruiters. To account for regional differences, 
they broke their sample of recruiters into two groups, one 
from recruiting stations with high enlistment rates, and the 
other from stations with low rates of enlistment. 

Several variables were statistically significantly 
related to productivity. Results from the high enlistment 
area group indicated that urban and suburban recruiters 
enlisted more people per month than rural recruiters, and 
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recru i ter s 



in their home state enlisted more people per 



month than those stationed more than 500 miles outside their 
home state. 

In the low enlistment areas, those who felt 
recruiting duty was a financial hardship enlisted more 
people per month than those who did not. Recruiters with 
prior service as career planners were more productive than 
those who had no experience as career planners. The 
regression equations were not cross-validated. 

2 . Best and Wylie 

These authors hypothesized that recruiter 
characteristics could be combined to predict recruiter 
performance [Ref. 24]. To test their hypothesis for Navy 
recruiters, they used a command evaluation of each recruiter 
in their sample as their dependent variable. Special 
consideration was given to selecting independent variables 
that could be obtained easily for each prospective recruiter 
prior to a recruiting assignment. 

The authors generated a cross-tabulation of the 
independent variables they had selected initially, and they 
retained for analysis those variables with the strongest 
relationship to the dependent variable. Those variables 
were: the area where the recruiter had spent his youth 
(urban, suburban or rural); age; General Comprehension Test 
(GCT) score (part of the Armed Services Vocational Aptitude 
Battery (ASVAB)); years of active military service; and 
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proximity of childhood home to a major body of water, 

grouped into three distance categories (less than 20 miles, 
20-200 miles, and more than 200 miles). 

The regression equation accounted for 34 percent of 

2 

the variation in the dependent variable (R = .34), and the 
equation was statistically significant (p < .05) for the 
original sample. Although the equation failed on cross- 
validation, the authors believed research using this 
approach should continue. The only predictor in use by the 

Navy at this time was the 16PF-m. As mentioned earlier, 
this test battery was a poor predictor of recruiter success, 
and the Navy stopped using it for recruiter selection in 
1976 [Ref. 1 3 : p . 24]. 

3 . Shupack 

This author attempted to develop a profile of a suc- 
cessful recruiter comprised of a combination of objective 
personal characteristics easily obtainable from existing 
personnel records [Ref. 13]. She regressed six independent 
variables against a dependent variable designed to identify 
success, mediocrity, and failure in the recruiting 
assignment. The independent variables were paygrade, 
education, years of service. Navy enlisted entrance test 
scores, rate, and scores on the 16PF-m. Her measure of 
effectiveness was defined in terms of Navy Recruiting 
Command's Honor Roll (five enlistments per month). 
Successful performance was defined as completion of the 
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twenty-month test period and some level of Honor Roll per- 
formance. Mediocre performance was defined as remaining in 
the field for the test period, and failure was being 
transferred early. 

Using multiple regression on the whole sample and on 
various subgroups, the explanatory factors explained a low 
fourteen and twenty-one percent of the variance in the case 
of successful and unsuccessful recruiters, respectively. A 
better criterion measure of production probably would have 
given Shupack's model more explanatory power. Education, 
paygrade, and entrance test scores explained the most 
variance among successful recruiters. For unsuccessful 
recruiters, the best predictors were rate, years of service, 
and entrance test scores. 

4 . El ig et al ■ 

In a 1983 working paper, these authors described a 
"new approach to recruiter selection research" [Ref. 4]. 
They suggested that previous selection approaches (bio- 
graphical information, personality assessment, and interest 
inventories) were vulnerable to compromise and probably 
would not be useful when recruiters were selected 
involuntarily. They also commented on the "criterion 
problem," saying that most researchers had not found an 
adequate performance measure. 
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With these criticisms in mind, along with the fact 
that the All Volunteer Army's recruiters had become a 
largely non-volunteer force, the authors' research sought 
two things: 

a. Predictors that were readily available, stable, and 
secure measures of recruiter characteristics, and 

b. Criteria that were readily available, objective perform- 
ance measures which differentiated among recruit 
characteristics, secure and were relatively free from 
"opportunity bias." 

The authors used the Enlisted Master File (EMF) as 
their data source for recruiter demographic characteristics 
and the Military Enlistment Processing Station Reporting 
System (MRS) to acquire information on recruit 
characteristics. Both types of data are maintained 
routinely by the Army. 

The authors hypothesized that the EMF data would 
provide measures of recruiter characteristics that would be 
useful in predicting productivity as measured by recruit 
characteristics taken from the MRS. They related recruiter 
characteristics to recruit characteristics, and their 
criterion was adjusted for opportunity bias. Brown et al . 
[Ref. 5) accounted for 48 percent of an individual 
recruiter's total production by using average total 

production of all recruiters in the individual's District 
Recruiting Command (DRC) as a predictor. Elig et al . , 

adjusted their criterion by subtracting DRC average 
production from the raw contract totals of each recruiter in 



the DRC. 
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The sample consisted of 552 male and 60 female 
recruiters on production during FY79. Descriptive 

statistics were used to analyze recruiters' characteristics. 
Those characteristics that correlated with contract 
production were identified using analysis of covariance 
techniques . 

Results of this study indicated that opportunity 
bias (DRC Average Production) explained 32 percent of the 
variance in productivity, compared to 48 percent found by 
Brown et al. The remaining variance was believed to have 
resulted from unmeasured opportunity bias, individual 
recruiter differences, and measurement error. All effects 
listed below were significant to at least the .01 level. 

a. Recruiter Education. Recruiters with postsecondary 
education recruited better educated, but lower AFQT, 
male recruits. 

b. AFQT. Recruiter AFQT correlated positively with recruit 
AFQT in its "prime" market, high school diploma graduate 
and senior males (HSDG/SR), and had little impact on 
females or non-high school graduates (NHSG). 

c. Gender. Recruiter gender had no effect on total numbers 
or quality of recruits. 

d. Age. Older recruiters contracted more male and fewer 
female recruits than younger recruiters. They did this 
by underproducing high AFQT and overproducing low AFQT 
recruits in the HSDG/SR market. In total production, 
younger males outproduced older males, while older females 
outproduced younger females. As Figure 2.2 shows younger 
male recruiters outperformed their female counterparts, 
while older females outperformed all others. 

e. Rank. Higher ranking recruiters achieved success in 

the HSDG/SR market by contracting more low AFQT (category 
IV) recruits than lower ranking recruiters. 
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Total Non-prior Service (NPS) Contracts 
by Recruiter's Age and Gender. (Ref. 4) 



60 



f. Ethnic Group. Like recruited like. Black recruiters 
enlisted the most Blacks, Hispanic recruiters enlisted 
the most Hispanics, Whites the most Whites, etc. 



The authors were encouraged by the results of their 
research. They believed recruiter demographic 

characteristics can be related to recruit characteristics 
when opportunity bias is removed, and that demographic data 
will be useful for selecting recruiters from a non-volunteer 
pool. Several questions remained. For example: 

1. Would these findings be replicated with other samples 
and in other recruiting environments (e.g., where 
unemployment is higher)? 

2. Why do tradeoffs exist between AFQT and education? 
Recruiters who penetrated the HSDG/SR market did so at 
the expense of AFQT. 

3. Are these relationships likely to continue? The data in 
this paper were simple correlations and were not tied to 
a well reasoned theory. At the end of their paper, the 
authors mentioned that they would attempt to cross- 
validate this paper's results and develop a theoretical 
rationale for them. 



E. OVERVIEW 

Although the literature review revealed a considerable 
amount of relevant work, many of the findings were 
disappointing. The profile of a "successful recruiter" seems 
to vary from one study to the next. Table 6 summarizes the 
personal characteristics that prior studies have indicated 
are significantly related to being a successful recruiter. 
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TABLE 6 



Character istics Related to Recruiter Success 
Summary of Results 



Plans ahead 

Uses systematic approach in prospecting 
Knowledgeable about recruiting 
Sales experience 

Age (older if female, younger if male) 

Marital status 

Education 

Paygrade 

Length of service 
AFQT scores 
Racial match 

Verbal fluency 
Persuasiveness 
Communicates effectively 

Sel f-motivated 

Ambitious 

Desire to excel 

Aggressive 

Dominant 

Confident 

Enthusiastic, positive 
Mature 

Financially stable 
Extroverted 

Enjoys working with others 

Spontaneous 

Influences others 

Well groomed 
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Most of the past research on recruiter selection 
suffered from one or more of the same serious flaws: poor 
criterion measurement, lack of knowledge of the recruiter 
job, and failure of results to remain significant upon 
cross-validation. As a result, findings of many of these 
studies are of questionable value. 

Most recent work has integrated lessons learned from 
earlier studies. Production measures have become more 
sophisticated, attempting to account for the powerful 
influence of "opportunity bias," or the effects of 
geographic, socioeconomic and organizational variables on 
individual recruiter productivity. Comprehensive job 
analysis has provided a greater understanding of what the 
recruiter's job really is. Astute researchers, recognizing 
that the military services need different types of selection 
devices now that most recruiters are not volunteers, have 
studied the use of passive selection procedures that use 
existing data and are less subject to compromise. Army 
researchers have described the shift in the purpose of the 
assessment center from selection to motivation and 
development. Yet, despite the increased sophistication of 
recent work, a reliable profile of the successful recruiter 
is still not generally agreed upon. Statistically 
significant findings are scarce, and very few results remain 
significant after cross-validation. 
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The Special Assignment Battery developed by NPRDC and 
the assessment center concept used extensively by the 
military services as well as private industry have provided 
perhaps the most encouraging results in recruiter selection 
research. A major drawback of both methods is their cost. 
Given our current relentless budget-cutting environment, 
cost is a major consideration. 

The Special Assessment Battery was found to be highly 
valid when recently cross-validated on a sample of Marine 
Corps recruiters. Background and personality characteristics 
and interest patterns appear to be associated with military 
recruiter effectiveness. But the battery is lengthy and 
would be costly to administer. If future non-volunteer 
recruiters who took the battery believed their scores would 
result in a recruiting assignment, potential sabotage would 
reduce the tool's usefulness. To minimize the probability 
of faking responses, personnel could complete the battery 
well before a time when they would associate it with 
recruiting duty, such as first reenlistment, and all 
personnel could be required to take it. But this would 
require large-scale administration and large related costs. 

The assessment center concept is heavily used and 

relied upon to select salespeople in private industry. The 
military services use assessment centers as part of 

recruiter training to indoctrinate and familiarize 
recruiters on their way to the field, providing them with 
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the basic skills they'll need in their jobs. But assessment 
centers can be costly, too. Those who don't complete 
recruiter training are transferred to other jobs. In 
addition to wasted transfer dollars caused by the 
unnecessary move, this may cause some other types of 
hardship for the member and/or the member's family. The 
assignment process must identify another person for 
recruiting school, while the empty job in the field remains 
unfilled that much longer, all of which costs money. 

Several studies attempted to identify passive recruiter 
selection procedures that would identify people who were 
most likely to become successful recruiters be fore they were 
assigned to recruiting duty. Although some personal and 
background characteristics were determined to be 
statistically significant, little if any mention was made 
regarding the relative importance of these characteristics 
in recruiter selection. Budget cuts and increasing numbers 
of non-volunteer recruiters underscore the importance of 
passive selection procedures. Significant research 
questions remain unanswered. Of the characteristics 
believed to be related to successful recruiting, what's the 
most important? What's the next most important? 
Researchers who identified the need for passive, readily 
available measures of recruiter characteristics were on the 
right track. But how many prospective recruiters possess 
all the characteristics believed to be part of the 
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successful recruiter profile? If one person has some of 
these characteristics, and another person has others, how do 
we choose between them? The next chapter describes a 
methodology for making decisions about the relative 
importance of characteristics determined in past studies to 
be important in the successful recruiter's profile. 
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Ill . METHODOLOGY 



The goal of this thesis is to identify personal 
characteristics associated with recruiter success. Insights 
from the study should yield management tools that would 
improve the process of selecting Army Reserve recruiters. 
One approach would conduct analysis of data from Army 
recruiters' personnel records and other data sources such as 
the Enlisted and Officer Master Files maintained by the 
services. Multivariate analysis such as logit or probit 
could be used to identify those individual characteristics 
associated with a successful recruiter. Some measure of the 
criterion, "recruiter success," would also need to be 
determined . 

For several reasons, an alternate approach to 
multivariate analysis of existing data is needed. Army data 
on personal characteristics of recruiters do not exist. 
Other relevant data were not available. The "criterion 
problem," or lack of a measure that could be used to explain 
the variance in recruiter productivity based solely on 
individual recruiter differences, would have made 
traditional analysis difficult. Without data on individual 
recruiters, even the best criterion would not have been 
useful. Perhaps the strongest argument in favor of an 
alternate approach, however, is the failure of many previous 
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studies to identify through traditional analysis 
characteristics predictive of recruiter success. 

A. MULTIATTRIBUTE UTILITY THEORY AND EXPERT SYSTEMS 

The Army Recruiting Command uses a group process to 
select its AGR recruiters. Group members review 
applications and make decisions based on a set of published 
criteria. (This process was described more fully in the 
introduction.) Criteria are not ranked or weighted in order 
of importance. Following an interview, each group member 
makes a decision about an applicant independent of other 
group members as to the probability that an applicant would 
be a successful recruiter. The procedure is subjective and 
is based on the experience, knowledge, judgment and 
intuition of the selecting officials. 

Some experts in the process of social decision making 
believe that decisions do, and should , depend on subjective 
quantities such as values and probabilities. Disagreements 
over policy decisions generally hinge on disagreements about 
values. Often, although those in conflict may agree about 
the relative dimensions of value, they disagree about the 
relative importance of various goals. Normally, such 
disagreements are fought out in the context of specific 
decisions, over and over again, at enormous social cost each 
time another decision must be made. (Ref. 25:p. 326] 
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Edwards suggested that organizational decisions should 
depend on some kind of social consensus, or aggregation of 
individual views, rather than on any single individual's 
views. Some aspects of value are matters of objective 
information, expertise, or both. tRef. 25:p. 326] 

Edwards proposed the use of multiattribute utility 
measurement as a solution to the problems encountered in 
this arena. The method can spell out exol icitl v the values 
of each group participant, show how and how much they differ 
and, in the process, reduce the extent of such differences. 
[Ref. 25 : p . 327] 

The Army Recruiting Command may be able to improve its 
selection process by applying Edwards' measurement 
technique. Its group process is affected by differing 
values among group members. By taking into account 
objective information regarding recruiter selection as well 
as relevant expertise among group members or other experts, 
the Army Recruiting Command could agree on a set of values 
for recruiter selection. By negotiating about, agree ing on, 
and (possibly) publicizing this set of values, recruiter 
selection could become more effective. 

Edwards' technique is based on extensive use of simple 
rating procedures. Every decision may have value on a 
number of different dimensions. The idea behind 
multiattribute utility measurement is to discover those 
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values, one dimension at a time, and aggregate them across 
dimensions using a suitable aggregation rule and weighting 
procedure. Edwards' procedure for obtaining group consensus 
has ten steps. They are listed briefly below: 

1. Identify the person(s) or organization s ) whose utilities 
are to be maximized. 

2. Identify the issue(s) (decisions) to which the utilities 
needed are relevant. 

3. Identify the entities to be evaluated. (For the Army 
Recruiting Command, these might be recruiter applicants.) 

4. Identify the relevant dimensions of value for evaluation 
of the entities. (Specify a simple list of goals that 
seem important for the purpose at hand.) 

5. Rank the dimensions in order of importance. (This can 
be done individually or in groups. An advantage of 
the group process is that arguments get on the table 
up front, and participants are more likely to start 
from a common information base.) 

6. Rate dimensions in importance, preserving ratios. (How 
much more important is one dimension than another?) 

7. Sum the importance weights, and divide each by the sum. 
This computation converts importance weights into numbers 
that, mathematically, are like probabilities. 

8. Measure the location of each entity being evaluated 
on each dimension. 
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9. Calculate utilities for entities. The equation is 

U = £ w u , and 21 w = I . U 
i j ij 1 1 i 

is the aggregate utility for the ith entity. w is 

j 

the normalized importance weight of the j th dimension of 

value, and u is the rescaled position of the 
i j 

ith entity on the j th dimension. Thus w is the 

j 

output of step 7, and u is the output of step 8. 

i j 

The equation is the formula for a weighted average. 

10. Decide by maximizing U . If a subset of i is to 

i 

be chosen, then the subset for which £ U is maximum 

i i 

is best. [Ref. 25:pp. 328-329] 

Several types of expert systems that incorporate 
multiattribute utility theory have been developed over the 
past few years to support decision making. The introduction 
of the personal computer and electronic spreadsheet programs 
are directly responsible for the rapidly growing popularity 

of these systems. One such system was selected to examine 

recruiter selection in this thesis. Before identifying 
criteria for selecting this system, however, it will be 
helpful to explain what expert systems are, how they are 

structured, and why they are useful. 

In the late 1970s, expert systems were a conceptual 

breakthrough in the field of computer science known as 
Artificial Intelligence (AI). In the sixties, AI scientists 
had attempted to simulate "thinking" by finding general 
methods for solving broad classes of problems. In the 
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seventies the scientists used more specialized programs, 
concentrating on techniques such as representation (how to 
formulate the problem to make it easy to solve) and search 
(how to control the search for a solution while minimizing 
required time and computer capacity). When the scientists 
realized that "the problem-solving power of a program comes 
from the knowledge it possesses, not just from the 
formalisms and inference schemes it employs," they developed 
special programs that were expert in some narrow area, and 
this new field was born. (Ref. 26: p. 4] 

Expert systems, also known as knowledge-based systems, 
apply AI reasoning and problem-solving techniques to 
knowledge about a specific problem to simulate the 
application of human expertise [Ref. 27:p. 16]. This 
allows the system to draw conclusions not programmed 
explicitly into the program. While traditional data 
processing techniques require certain input, use well- 
understood algorithms, and produce correct answers, expert 
systems use information that is not always consistent or 
complete, apply symbolic reasoning methods without following 
a numeric model, and produce satisfactory answers. Of 
course, the more knowledge the system has about a problem, 
the more effective the system is likely to be. [Ref. 27:p. 
17] 
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Several players are involved in the process of building 
an expert system, or knowledge engineering, as depicted in 
Figure 3.1. The expert system is the computer software that 
solves the problem of interest. The domain or area expert 
is a person known for producing good solutions to the 
particular type of problem under study. The knowledge 
engineer is someone who knows how to build expert systems. 
The engineer's tasks include interviewing the experts, 
organizing the knowledge, and deciding how to represent it 
in the expert system. The expert-system-building tool is 
the programming language used by the knowledge engineer to 
build the system. The user is anyone who uses the expert 
system once it is developed. [Ref. 26:p. 9] 

The heart of an expert system is its knowledge, or the 
information needed before the computer program can "behave 
intelligently." This knowledge is organized by facts and 
rules. Many rules in an expert system are called 
heuristics, or rules of thumb that limit the search for 
solutions. Expert systems use heuristics because the 
problems these systems try to solve are often difficult and 
poorly understood, and resist rigorous mathematical analysis 
or algorithmic solutions. (An algorithmic method provides 
the correct or optimal solution, while the heuristic method 
provides an acceptable one.) Heuristic rules make the 
search for solutions easier and more practical. [Ref. 26:p. 
17] 



73 




Figure 3.1. The Players in the Expert System Game. 
[Ref. 26 : p . 8] 
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Knowledge representation, or structuring knowledge in a 
program, can be accomplished by using one or more standard 
techniques. Three techniques used most frequently in 
building expert systems are rules, semantic nets, and 
frames. [Ref. 26:p. 20] The rule-based technique uses 
IF (condition) and THEN (action) statements. If a problem 
matches the IF part of a rule, the THEN action is taken. 
This technique is the most popular in building expert 
systems. It provides a natural way to describe processes in 
a complex and rapidly changing environment, offers an 
opportunity to look at the problem one step at a time and 
react appropriately, and simplifies the job of explaining 
what the program did or how it reached a particular 
conclusion. [Ref. 26:p. 21] The rule technique is well- 
suited for representing deductive knowledge, such as cause 
and effect problems [Ref. 27:p. 18]. 

Both frame and semantic nets are frame-based 
representation methods. These methods use a network of 
nodes connected by relations and organized into a hierarchy. 
Each node represents a concept that can be described by 
attributes and values associated with the node. Frames are 
well-suited to represent descriptive and relational 
knowledge that clusters or conforms to stereotypes, and 
semantic nets are useful in modeling classifications or 
casual linkages. [Ref. 27:p. 18] 
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Expert systems have been used successfully to solve a 
wide variety of problems, particularly those requiring the 
sort of judgmental decisions people make every day. The 
most well-known expert system may be MYCIN, which can 
recommend treatments for suspected meningitis and other 
bacterial infections of the blood by analyzing a doctor's 
observations of a patient. (Ref. 27:p. 16] 

An expert system may be a useful approach to a problem 
when: 

- A solution has a high payoff: solutions are needed, and 

other methods have not worked 

- The problem can be solved using an expert's knowledge 
rather than a particular algorithm 

- Experts are available who can formalize the knowledge 
needed to solve the problem 

- The problem does not necessarily have a unique answer, and 

- The problem changes. (Ref. 27:p. 20] 

The expert system selected to examine AGR recruiter 
selection is EXPERT87, a special type of expert 

system/decision aid based upon a concept its designer has 
labeled Quasi-Artificial Intelligence (QAI) [Ref. 28]. 

Before describing EXPERT87 further, though, an explanation 
of QAI and its advantages over traditional AI in the 
development of expert systems will be helpful. 

Hoffman indicates that significant problems exist in 
traditional AI and expert systems that prevent them from 
being as useful as they might be. Some of these problems 
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of AI 



concern the adequacy of the "cognitive engines" 
systems in their ability to simulate correctly human 
reasoning processes. Other problems concern the 

completeness, general izabil ity, and validity of the 

production rules which are developed, as well as certain 
issues in mathematical statistics. Although solutions to 
these and other problems are being sought, Hoffman argues 
that needs exist for expert systems now, and that QAI, a 
less ambitious variant of AI, may be able to meet some of 
those needs. [Ref. 28:p. 3] 

QAI builds upon a well-defined format for the problem 
space. Mathematically, a QAI problem space is hierarchical 
and geometric, as opposed to linguistic or symbolic, as in 
AI . QAI systems present the attributes of decision 
alternatives by means of (1) wel 1 -structured profiles of 
hypothetical case data, rather than by descriptive phrases, 
(2) queries requiring either binary or probablistic 

judgments, or (3) by means of hypotheticals which require 
the expert to invoke plausible propositions and rules. In 
QAI, experts' inferential processes are expressed as simple 
functional relationships rather than complex Boolian 
expressions that link large, unstructured sets of production 
rules. [Ref. 28:p. 3] 

QAI is not intended for the breadth of problems AI 

systems hope to solve. It is not meant to be a reasoning or 

problem-solving tool in the formal sense and does not 
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attempt to extract higher levels of meaning from rules or 
propositions which are developed. Rather, QAI is intended 
for the large class of moderately difficult and repetitive 
decision problems which so often face managers and decision 
makers. QAI enables coherent and objective decisions to be 
made when no known cr iter ion or dependent var iable is 
available for the development of an empirical model. It 
enables efficient interaction of experts with a knowledge 
base, and a presentation of the process (and results) in a 
form which can be understood by the expert and/or by other 
prospective users of the system. (Ref. 28:p. 5] 

EXPERT87 provides a format for gathering intuitive 
knowledge from experts in minimal time, and in a manner that 
would permit verifiable estimation of the trustworthiness of 
expert systems that emerge. The method is based on 
mathematical theory that allows the computer program to 
generate hierarchically ordered profiles of hypothetical 
alternatives. Hierarchical structuring of a problem's 
concepts avoids cognitive overload of experts, which assures 
a more beneficial utilization of attribute information. 
Attribute values for profiles the program generates are 
chosen to optimize the likelihood that the expert's 
resulting model correctly represents the expert's intuitive 
knowledge. [Ref. 28:p. 4] 
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Several important principles that underly the 
development of EXPERT87 follow [Ref. 29): 

1. Intuition is a component of thought processes. One of 
the basic principles of decision making is that people 
have sound, intuitive bases for acting on given 
problems, even though they can seldom express or 
describe their knowledge objectively. The intuitive 
knowledge they possess about a problem is made up of 
their observations about specific elements or 
attributes of a problem, which they seldom explicate 
when they make subjective judgments or 
evaluations . 

2. Cognitive abilities are limited. In a well-known 
research article of the 1950's, "The Magic Number 
Seven, Plus or. Minus Two," psychologist G. A. Miller 
wrote that humans cannot effectively deal with more 
than about seven concepts at one time. Miller 
demonstrated the validity of this principle, to within 
one or two categories, across a wide spectrum of human 
perceptual and cognitive activities. For this reason, 
EXPERT87 (and other similar software) limits problems 
to seven concepts with seven attributes per concept. 

3. Cognitions are not easily communicated. People 
cannot communicate very clearly about their 
thought processes. They do not know what information 
is routinely ignored or discounted in their thinking. 

Nor do they often know how much importance they 
attach to each item of information, concept, or 
criterion when making decisions. When asked to 
assign weights to those factors which influence 
their decisions, they are often hesitant and 
sometimes unable to do so. 

4 . There is a mathematics of intuitive processes. The 
system is designed to overcome the difficulties 
described above and capture experts' intuitive 
knowledge without forcing them to think like mathema- 
ticians. The interactive process between expert 
and computer generates the functionality between 
attributes of alternatives and the overall merit of 
the alternatives. The mathematically derived 
functionality of the system makes it unique, an 
expert system which is not "rule-based" in the usual 
sense, but is function-based in the sense of being able 
to express in rather simple algebraic form the funda- 
mental nature of the expert's intuitive processes. 

Now the system can respond to each new decision 
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problem using a functional model of expert intuition 

which accurately reflects only the consistent and 
reliable components of these intuitions. 

5 . Hierarchies express relations between concepts and 

attr ibutes "Hierarchies are innate to the human way 

of thinking, of breaking reality in clusters and 
subclusters" [Ref. 30:p. 8-4], According to L. L. 

Whyte, "The immense scope of hierarchical classifica- 
tion is clear. It is the most powerful method of 
classification used by the human brain-mind in 
ordering experience, observations, entities and 
information. ... The use of hierarchical ordering must 

be as old as human thought, conscious and unconscious." 
[Ref. 30 :p. 8-4] In EXPERT87, hierarchies are tree 
structures carefully designed to define a problem 
in a comprehensive, meaningful, and well-organized way. 
Solutions are represented as alternatives, and the 
expert's task is to evaluate the alternatives. When 
the program evaluates an alternative, it uses the 
expert's own set of primary defining concepts and 
attributes . 

6 . Hypothetical constructs can be mapped into intervening 
variables. The difference between concepts and 
attributes is an important part of understanding 
EXPERT87. Attributes are specific, and people agree 
on their meaning. Concepts are general, and indi- 
viduals impose their own unique meaning on concepts 
they use. Psychologists use the terms hypothetical 
construct and intervening variable to make clear the 
distinction between unquantified ideas and operation- 
ally defined measures. Figure 3.2 depicts an 
individual's construct (labeled "V") as a somewhat 
vague and incompletely specified set of ideas. The 
figure illustrates the explication of the construct, 
first by defining it in terms of measurable attributes, 
and then in the generation of an expert system, or a 
functional definition of the construct. It 
contains a process for mapping information from 
measurable attributes into a measure, here labeled 
an intervening variable. The measure, V, is an 
operational definition of the construct. 

Figure 3.3 illustrates the substitution of hypothetical 
constructs as concepts of a hierarchy. The linkage 
between attributes and constructs is missing, and 
EXPERT87 will construct this linkage after interacting 
with an expert and using its knowledge about the way 
the expert responds to problems. 
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Figure 3.2 Transforming Concepts/Constructs into 
Variables. (Ref. 29) 
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Figure 3.3 Defining Problems in Terms of 
Heirarchies. (Ref. 29) 
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7 . Effective decision-aids develop understanding and 
confidence . Principles developed by cognitive 
psychologists have led to the ability to represent 
decision processes on a microcomputer, to make explicit 
the underlying (largely intuitive) knowledge and 
expertise of decision-makers, and to structure 
decision problems in hierarchical form. This can 
help users define their terms and concepts and clarify 
their thinking. It can also help them get a 
better understanding of the consistent and reliable 
components of their intuitive reactions to sets of 
information. 



As in all commercially available expert systems 
software, EXPERT87 is proprietary, therefore detailed 
information about its algorithms and operations is limited. 

To summarize, EXPERT87 was selected for this thesis 
because : 

- the software is easy to use 

- expert systems are developed easily and quickly, 
feedback is immediate, and results are easily understood 

- the software can handle a wide variety of decision making 
problems, and 

- the program's cognitive engine is deductive rather 
than inductive, which simulates human thinking and 
reasoning more accurately than expert systems developed 
with traditional AI . 



B. THE MODEL 

Alternative models of the recruiter selection process 
can be constructed. A particular problem can have more than 
one "correct" model. According to T. L. Saaty, "Individuals 
informed about a particular problem may structure it 
somewhat differently, but if their judgments are similar, 
their overall answers tend to be similar . . . the process 
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is robust" [Ref. 30:p. 8-4]. Saaty's work is the basis of 
Expert Choice, another decision support software package. 

Figure 3.4 depicts the hierarchy developed to model the 
profile of a successful recruiter. The goal of the model, 
to "Identify Characteristics of the Successful Recruiter," 
is the node at the top of the hierarchy. 

Based on the literature review and other information, 
characteristics believed to be related to recruiter success 
have been identified (see Table 6 in Chapter II). These 
characteristics are related, and can be organized into 
categories. Logical categories are Administrative Skills, 
Communications Skills, Background Characteristics, 

Personality Characteristics, and Specific Experience. These 
categories, or dimensions, become the largest branches, or 
nodes, of the hierarchy. The characteristics, or 
attributes, within each dimension become smaller branches, 
or nodes, of the hierarchy. 

1. Administrative Skills 

- Planning 

- Organizing 

The Administrative Skills dimension covers aspects of 

the recruiter's job related to planning and organizing. 

Successful recruiters are well organized. They plan 

well, and use and follow their plans. 

2. Communications Skills 

- Speaking Skills 

- Informing 
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Figure 3.4 The Model: Profile of the Successful Recruiter. 



- Persuading. 

Many communications skills are related to recruiter 
success. The literature suggests that speaking, 
informing, and persuading are important communica- 
tions skills. 

- Foreign Language Skills. 

The ability to speak a foreign language can be an 
important skill, particularly in markets where 
applicants' parents do not speak English. This skill 
can allow a recruiter to build trust with parents who 
often have a great deal of Influence over their 
child's enlistment decision. 

- Listening Skills. 

A former Navy recruiter who tested the model believes 
listening skills are the most Important aspect of a 
recruiter's communication. By asking open-ended 
questions and 1 istening care fully to what the 
potential appl leant savs , the successful recruiter 
can provide information targeted specifically at the 
needs and desires identified by the individual. The 
attribute, listening skills, was added to the Commun- 
ications Skills dimension. 

- Writing Skills. 

Because the recruiter's job involves very little 
writing, it is unlikely that strong writing skills 
are an important characteristic of the successful 
recruiter. But since writing is such a large part of 
communicating, writing skills were included in the 
model . 

3. Background Characteristics 

- Age 

- Gender. 

The literature varies on the subject of which 
background character istics are related to recruiter 
success. Regarding age and gender, one study found 
that older women and younger men were more successful 
than their counterparts [Ref. 4]. Other studies 
found that gender made no difference. 

- Years of service. 

With respect to age and years of service, a recruiter 
must have experience in the service and/or be old 
enough to have some credibility. At the same time, 
the recruiter shouldn't be so old or senior that a 
tour in recruiting might be the last one before 
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retirement eligibilty. At such a time, many workers 
become less motivated than in the past, acquiring 
what servicemember s call a "short timer's attitude." 
In one study, the oldest recruiters were found to be 
among the least successful, and the authors concluded 
that this "twilight tour effect" may have been 
responsible [Ref 13]. 

- Race/Ethnicity. 

One study found that racial match, or being assigned 
to a market where prospects are people most like the 
recruiter, was related to recruiter success [Ref. 4]. 

- Intellect. 

Most of the literature suggests that intellect is 
directly and positively related to recruiter success 
— the smarter the recruiter, the better. Education 
and ASVAB scores are often used as readily available 
measures of intellect. 



- Spouse support. 

One aspect of recruiting that affects the probability 
that a recruiter will be successful is the issue of 
family support, particularly support of the spouse. 
Recruiting duty often means living away from the 
military community and services the family depends 
upon. Living away from military exchanges, commi- 
ssaries, and medical facilities can create or 
increase financial hardship and stress for families. 
Recruiting often involves long hours and large 
amounts of time away from home. Most married (and 
formerly married) recruiters believe it takes a 
strong marriage and an especially supportive spouse 
to deal well with the added stresses brought on by 
recruiting duty. 



Personality Characteristics 

Although these characteristics may be the most 
difficult to measure, both the literature and re- 
cruiters strongly suggest that this is the most 
important dimension. Some types of people will be 
successful recruiters, while others will not, and 
personality is key. The literature suggests that a 
large number of personality characteristics are related 
to recruiter success (see Table 6 in Chapter II). This 
list of characteristics is too long for this model (the 
software limits a dimension's attributes to seven for 
reasons explained earlier), so similar characteristics 
were combined, and the seven that seemed the most 
important were selected. 
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- Motivation. 

Drive, energy, ambition, desire to excel, and motiva- 
tion were interpreted similarly by those who tested 
the model. Motivation was selected to describe these 
personality characteristics, which many believe is 
related to success in any endeavor, particularly 
recruiting . 

- Extroverted. 

Someone who is extroverted and sociable, who enjoys 
working and talking with others, is thought more 
likely to succeed in recruiting than someone who is 
not . 

- Flexibility 

- Resilience. 

These are believed to be important characteristics 
due to the demanding and changeable nature of 
recruiting. How well a recruiter adjusts to changing 
situations, and how well the recruiter bounces back 
after repeatedly being turned down, are thought to be 
good indicators of a recruiter's ability to succeed 
over time. 

- Sense of humor. 

This may help a recruiter enjoy the job, and life in 
general, and may help keep the recruiter on an even 
keel in a demanding job. 

- Integrity 

- Commitment. 

Many recruiters (and former recruiters) believe 
integrity and commitment to the organization are 
critical to recruiting success. All other things 
equal, those recruiters who care about finding good 
people/service matches, putting only the best people 
in their service, and doing the job with integrity 
were thought likely to be the most successful in the 
long run. 

5. Specific experience 

Various types of experience are thought to be related 
to recruiter success. 

- Recruiting experience. 

This type of experience may be the most relevant, par- 
ticularly if the recruiter did well in the past. 
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- Sales experience. 

This may substitute for recruiting experience, as 
recruiters are often described as salespeople. 

- Recruiter training. 

Many aspects of recruiter training are thought to be 
important to recruiting success, such as effective 
sales techniques, sales philosophy, etc. 

- Public speaking experience may also be related to 
recruiter success. 

For each of the five dimensions described above, 
EXPERT87 will generate a number of hypothetical profiles 
which each expert will evaluate. The software will generate 
a specially constructed set of attribute values for the 
attributes which define the dimension. (The program will 
generate a larger number of profiles for dimensions with 
larger numbers of attributes.) Profiles are presented in 
graphic form for the expert to examine, reflect on, and 
assess, as depicted in Figure 3.5. Experts use their own 
experience, knowledge, and intuition to evaluate the 

dimension. 

After the last profile has been evaluated, the software 
completes its mathematical routines and stores functional 
relationships between attributes and dimensions. Now that 
the expert system is in place, it can evaluate real 
alternatives based on each expert's own expertise. One more 
profile is displayed evaluated based on the expert system 
just created. After the expert enters his/her assessment, 
the computer displays its findings. With reasonable care, 
the expert's response should be accurate to within five or 

six percent accuracy (Ref 29:p. 51]. 
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Figure 3.5 Hypothetical Profiles Presented in 
Graphic Form. (Ref. 29) 
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EXPERT87 contains a Fidelity Index which indicates how 
successful the program was in developing an expert system 
that correctly models the expert's own intuitions. If 
Fidelity is less than 70 percent, the expert's evaluations 
were probably inconsistent, which means that the intuitive 
or cognitive processes underlying the expert's assessments 
were not used in a consistent way (Ref 29:p. 531. 

Relative weights are also calculated for each expert, 
indicating how important the attributes or dimensions are. 
The software also determines (for each expert) the shape of 
the function of each attribute, whether the relationship is 
positive or negative, monotonic or non-monotonic, convex, 
concave, or linear. 



C. THE EXPERTS 

Paul Johnson, a scientist who has studied the behavior 
of human experts for many years, describes what is meant by 
the term "expert": 

An expert is a person who, because of training and 
experience, is able to do things the rest of us cannot; 
experts are not only proficient but also smooth and 
efficient in the actions they take. Experts know a great 
many things and have tricks and caveats for applying what 
they know to problems and tasks; they are also good at 
plowing through irrelevant information in order to get 
at basic issues, and they are good at recognizing problems 
they face as instances of types with which they are 
familiar. Underlying the behavior of experts is the body 
of operative knowledge we have termed expertise. It is 
reasonable to suppose, therefore, that experts are the 
ones to ask when we wish to represent the expertise that 
makes their behavior possible. (Ref. 26:p. 5] 
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In the recruiter selection problem, obvious experts 
would be those who know best what it takes to succeed in 
recruiting: recruiters who are doing the job. Current 
experienced AGR recruiters were selected as experts to 
evaluate the model described above. 

Others at various levels of the USAREC chain of command 
are also involved in the AGR recruiter selection process and 
could be considered experts. In addition to their 
responsibilities to recruit recruiters, endorse applications 
for recruiting positions, and serve on the boards used to 
select AGR recruiters, many of these people also have 
recruiting experience. Experts were sought from these 
various levels of the Army Recruiting organization to 
determine how or whether the profile of the successful 
recruiter changes from one person and/or organizational 
level to another. 

For ease of data collection, experts were located within 
the San Francisco Army Recruiting Battalion, and Recruiting 
Stations within that battalion's Gilroy Company. Five 
experts participated in the project. Experts 1 and 2 are 
Gold Badge AGR recruiters (decorated for recruiting 
success). Expert 3 is a former AGR recruiter currently 
assigned to the San Francisco Recruiting Battalion. Expert 
4 is a Station Manager and Regular Army recruiter. Expert 5 
is a former AGR recruiter currently assigned to USAREC 
Headquarters . 
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D. COMPARISON/CONTRAST OF EXPERTS 

The next chapter will analyze the similarities and 
differences of the expert systems created by each of the 
five experts. Trends and relative weights among dimensions 
and attributes will be examined to determine whether a 
consistent, clearly identifiable profile of a successful 
recruiter emerges. The five expert systems will also be 
examined to determine whether they vary in any systematic 
way across levels of the Army Recruiting organization. 

The analysis will also include an evaluation of 
hypothetical recruiter applicants. Not only will this 
provide an opportunity to compare five different experts' 
ratings of the same applicants, it will also be possible to 
determine how and why each expert system rated the 
applicants as it did. 
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IV. ANALYSIS AND RESULTS 



A. THE EXPERTS 

The expert system developed for each of the five 
recruiting experts will be evaluated and compared in terms 
of three concepts: Fidelity, Standards, and Discr- 
iminability. The indices for each of these concepts, which 
range from 0 to 100, can be used to interpret the worth of 
an expert system. It is important to distinguish between 
evaluating the worth of an expert system and determining 
whether the individuals generating the expert systems were, 
in fact, "experts. 1 ' For example, high Fidelity means only 
that the expert was consistent in evaluating alternatives. 
The indices cannot determine the amount of knowledge an 
individual possesses about a particular subject. 

The Fidelity Index measures how well the expert system 
correctly reproduces the intuitive judgments of the expert. 
If the Fidelity Index is 100, the expert system models the 
expert's judgments perfectly. A Fidelity Index of less than 
70 indicates that the expert's evaluations were not 
consistent, and 40 means they were very inconsistent. The 
software calculates Fidelity Indices for all levels of the 
hierarchical model. 
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After an expert enters assessments of the model's 
hypothetical profiles, the software generates an expert 
system. Once created, the program uses the expert system to 
predict assessments for the same profiles the expert 
reviewed. Any difference between an expert's actual 
assessment of a profile and the expert system's predicted 
value is called error. The software calculates for each 
expert the Mean Squared Error within each dimension and for 



the 


overall model. If the 


Fidel ity 


Index is 


high. 


errors 


for 


individual assessments 


and the 


overal 1 


Mean 


Squared 



Error should be small. 

The Standards Index measures the extent to which the 
experts maintain high standards on their assessments of 
hypothetical profiles of recruiters as opposed to being 
lenient or generous. For this measure, an Index of 80 
indicates that the expert has high or exacting standards, 
and 20 indicates leniency. 

The Discrimination Index is a measure of the expert's 
ability to make fine distinctions among hypothetical 
profiles of recruiters. An Index of 80 indicates that the 
expert is highly discerning, and 20 indicates inaccuracy or 



inability 


to 


distinguish among 


profiles . 


As 


with the 


Fidelity 


and 


Standards 


Indices , 


the software 


calculates 


Discrimination 


Indices 


for each 


dimension as 


well as the 



overall model. 



95 



Appendix A displays, for each of the five expert 
systems, the Indices mentioned above as well as the Mean 
Squared Error and the explained variance in each dimension 
and the overall model. 

For all five expert systems, the overall model Fidelity 
Index was above 90, and was at least 90 for most of the 
individual dimensions as well. Results for Experts 1 and 4 
include Fidelity Indices in the high 80s on the Background 
Characteristics dimension. Expert l's results also include 
a Fidelity Index in the high 80s on the Personality 
Characteristics dimension. (Note: These two dimensions 
contain the largest number of attributes the software 
permits, and several experts expressed the difficulty they 
encountered in making assessments.) 

For the overall model, the experts' Standards Indices 
ranged from 25 to 79. The two AGR recruiters were the most 
lenient, and the Recruiting Station Commander had the 
highest Standards Index. Although the Standards Indices 
varied across dimensions for all experts, those experts 
whose Standards Indices were low for the overall model 
tended to have lower Indices than the other experts for the 
individual dimensions as well. 

The experts' Discrimination Indices ranged from 62 to 94 
for the overall model. Expert 3, a former AGR recruiter, 
had the highest Discrimination Index. Expert 2, currently 
an AGR recruiter, had the lowest, which was still above what 

the software documentation calls the "normal range." 
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B. DIMENSIONS 



Table 7 is an aggregation of relative weights assigned 
to the model's five dimensions by each of the five experts. 
The weights for each column will sum to (approximately) one. 
One interpretation of these weights for Expert 1 is that 
Communications Skills dimension, with a relative weight of 
.37, is approximately four times as important as the 
Administrative Skills dimension, which has a relative weight 
of .093. Specific Experience (.255) is approximately five 
times as important as Background Characteristics (.058) in a 
successful recruiter. (Appendix B contains more detailed 
data displays for each expert.) 

Table 8 lists the five expert systems' most, second 
most, and least important dimensions as well as their 
relative weights. Personality Characteristics, 
Communication Skills, and Specific Experience were judged 
the most important dimensions. Background Characteristics 
were relatively less important for the five experts. 
Administrative Skills were judged least important by three 
of the five experts. 

C. ATTRIBUTES 

This section discusses attributes the experts judged 
most important within the dimensions mentioned earlier. 
Again, further explicit detail for all attributes and 
dimensions of the five expert systems is contained in 
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TABLE 7 



Relative Weights of Dimensions 



Dimension : : : 




: 1 : 2 ! 3 


4 : 5 


Expert : : : 





Administrative 

Skills 


.093 


.065 


.1241 


.073 


.086 


Communication 

Skills 


.37 


.208 


.1303 


.386 


.244 


Background 

Characteristics 


.058 


.18 


.1701 


.078 


.199 


Personality 
Charac ter istics 


.224 


.211 


.4021 


.269 


.407 


Spec if ic 
Experience 


.255 


.336 


.1734 


.194 


.064 
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Most/Least Important Dimensions 
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for 



Appendix B, and each expert's relative weights 
attributes within a dimension will sum to (approximately) 
one . 

1 . Personality Characteristics 

Table 9 examines the judgments the experts made 
about the attributes of the Personality Characteristics 
dimension. Three of five experts judged Motivation most 
important, while the other two experts said Integrity was 
the most important personality attribute. In three of five 
cases. Motivation and/or Integrity were judged nearly three 



times as 


important 


as the next closest 


attribute 


in 


this 


d imens ion . 


Commitment, Flexibility, 


and 


Sense 


of 


Humor 


received a 


variety 


of judgments. 


Two 


experts 


judged 


Resil ience 


as the 


least important 


attr ibute 


in 


this 



dimension. 

2 . Communications Skills 

As described in Table 10, the experts consistently 
identified Listening and Informing as the most important 
attributes within the Communication Skills dimension. In 
one case (Expert 4), Listening was nearly six times as 
important as Writing, which was judged least important. 
Persuading and Speaking Skills received a variety of 
ratings, while Writing Skills and Foreign Language Skills 
were judged least important. 
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Most/Least Important Attributes of Communications Skills Dimension 
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TABLE 11 



ce Dimension 


in 


Sales 

Experience 

.344 


Recruiting 

Experience 

.332 


Public 

Speaking 

Experience 

.152 
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3 . Specific Experience 



Among the attributes within the Specific Experience 
dimension. Recruiting Experience was most important and 
Public Speaking Experience was least important. For those 
experts who believed that sales experience was a substitute 
for recruiting experience (two of three of these experts are 
AGR recruiters), the two attributes were judged very 
important, and the relative weights for these attributes 
were similar. The two people whose expert systems 
distinguished between sales and recruiting experience judged 
Recruiting Experience and Recruiter Training as the most 
important attributes in this dimension. Table 11 summarizes 
these judgments. 

4 . Background Characteristics 

Although the Background Characteristics dimension 
received a variety of ratings across experts and generally 
was rated less important than other dimensions, the relative 
ranking of attributes within this dimension showed 
substantial consistency. Four of five experts judged 
Intellect as the single most important attribute in this 
dimension by a noticeable margin. Spouse Support was judged 
very to moderately important. Gender, Age, Vears of 
Service, and Rank/Paygrade received a variety of ratings, 
but in most cases, these attributes were significantly less 
important than other attributes. 
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The five experts 


were 


asked 


to interpret 


the 


Race/Ethnicity attribute as 


a " 


racial 


match" issue. 


In 


other words, compared to 


the 


other 


attributes in 


the 



Background Characteristics dimension, experts were asked how 
important it is for a recruiter to be the same race or have 
the same ethnic background as the people in the recruiter's 
market. This attribute had the largest spread of relative 
weights of the seven in this dimension. One expert judged 
Race/Ethnicity to be slightly more important than Intellect 
but less important than Spouse Support. Another expert 

believed Intellect was 40 times more important than 

Race/Ethnicity. Three experts ranked the attribute second, 
one expert placed it in the middle of seven attributes, and 
one person's expert system assigned it a relative weight of 
nearly zero. 

5 . Administrative Skills 

Three of five experts believed Administrative Skills 
was the least important dimension in the model. The other 
two experts ranked this fourth of five dimensions, but for 
four of the five experts, large gaps existed between the 
relative weights assigned Administrative Skills and the next 
most important dimension. Within this dimension, experts 
believed both Planning and Organizing are important 
attributes. Although the Administrative Skills dimension 
was less important relative to others in the model, planning 
and organizing abilities were important, and one skill did 

not substitute for the other. 
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D. COMPARING THE EXPERT SYSTEMS 



This phase of the analysis used the five expert systems 
described above to evaluate a set of five hypothetical 
recruiter applicants. Admittedly, ratings on many 
attributes in the model would not be obtainable from 
existing data, nor could they be measured objectively. To 
obtain ratings on some of these attributes, subjective 
assessments would have to be made. For purposes of the 
analysis, however, an assumption was made that ratings on 
all attributes in the model (1) were measurable and (2) were 
agreed upon by the five experts whose systems were used to 
evaluate the "applicants." That is, all of the experts 
assessed the same applicant as possessing the same objective 
profile of attributes. The experts differ (if they do) in 
their relative evaluations of the attributes that contribute 
to being a successful recruiter. 

Five hypothetical recruiter applicants were created for 
evaluation. Their profiles are contained in Table 12. By 
design, two applicants lie at opposite ends of the rating 
scale (1-9) on all attributes. The high-ranked applicant 
should end up as every expert's first choice, and the low- 
ranked applicant should be a unanimously poor or 
unacceptable choice for all experts. These extreme cases 
will illustrate how judgments are affected by the Standards 
Index. Experts whose standards are high tend to assign 
lower ratings than more lenient experts. Recall that 
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TABLE 12 



Attribute Ratings of Five Hypothetical Recruiter Applicants 



Attribute/ 

Applicant 


A 


B 


C 


1 

D 


i 

E 


Planning 


3 


5 


5 


5 


9 


Organizing 


3 


5 


5 


5 


9 


Speaking 


3 


8 


5 


5 


9 


Writing 


3 


8 


5 


5 


9 


Listening 


3 


8 


5 


5 


9 


Foreign 

Language 


3 


8 


5 


5 


9 


Informing 


3 


8 


5 


5 


9 


Persuading 


3 


8 


5 


5 


9 


Age 


3 


5 


5 


5 


9 


Gender 


3 


5 


5 


5 


9 


Race/ 

Ethnicity 


3 


5 


5 


5 


9 


Years of 
Service 


3 


5 


5 


5 


9 


Rank/ 

Paygrade 


3 


5 


5 


5 


9 


Intellect 


3 


5 


5 


5 


9 


Spouse 

Support 


3 


5 


5 


5 


9 
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TABLE 12 



Attribute Ratings of Five Hypothetical Recruiter a- .cants 

(Continued) 






Attribute/ 

Applicant 


A 


B 


C 


D 


P 


Motivation 


3 


5 


8 


5 




Commitment 


3 


5 


8 


5 


9 


Extroverted 


3 


5 


8 


5 


9 


Flexibility 


3 


5 


8 


5 


9 


Integrity 


3 


5 


8 


5 


9 


Resilience 


3 


5 


8 


5 


9 


Sense of 
Humor 


3 


5 


8 


5 


9 


Sales 

Experience 


3 


5 


5 


8 


9 


Recruiting 

Experience 


3 


5 


5 


8 


9 


Recruiter 

Training 


3 


5 


5 


8 


9 


Public Speaking 
Experience 


3 


5 


5 


8 


9 
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Appendix A contains data on the Standards, Fidelity, and 

Discrimination Indices for the five expert systems. 

The other three recruiter applicants also have specially 
constructed sets of attributes. All three have arbitrary 
ratings of five (4.5 is the minimally acceptable rating on 
the scale used by the software) on all attributes except 
those within one of the three dimensions identified earlier 
as the most important according to one or more of the five 
experts (Personality Characteristics, Communication Skills, 
and Specific Experience). On these attributes, an applicant 
will have ratings of eight. This will provide an 
opportunity to review the judgments each expert system makes 
and analyze the similarities and differences among them. 

As expected, all five expert systems selected Applicant 
E by an overwhelming margin. As shown in Table 13, on a 
scale of 1-100, overall profile scores range from 86.4 to 
99, which places Applicant E in the Superior range of all 
five expert systems. This is no surprise, as this 
applicant's profile was specially designed to result in 
unanimous selection. The results show that the expert 
systems created by those experts with the highest standards. 
Experts 3 and 4, generally rated applicants lower than 
experts with more lenient standards. 

As expected, all five expert systems rejected Applicant 
A. However, if 45 had been the cut-off for minimal 
acceptability, as it is in EXPERT87, Expert l's rating of 42 



109 



TABLE 13 



Expert Systems Evaluate Hypothetical Applicants 



CHOICE/ 

EXPERT 


1 


2 


3 


4 


5 


First 


E 


E 


E 


E 


E 




99 


99 


99 


86.4 


97.7 


Second 


B 


D 


D 


D 


C 




91.4 


75.7 


56.7 


58.4 


59.9 


Third 


C 


C 


C 


B 


B 




82.3 


67.4 


56 


53.4 


58.7 


Fourth 


D 


B 


B 


C 


D 




76 


61.4 


49.4 


50.7 


46.9 


Fifth 


A 


A 


A 


A 


A 





42 


38.5 


-32.5 


16.9 


28.5 
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would have come close to the cut-off, even though Applicant 
A was rated Below Standard (ratings of three) on all 
attributes. Another look at the Standards Indices (Appendix 
A) reveals that Expert 1 has the lowest Standards Index (is 
the most lenient) of the five experts on the Overall 
Profile. Had the ratings been slightly higher (ratings of 
four on all attributes, for example), this expert system 
(and possibly others) may well have found Applicant A 
acceptable, even though all individual attributes would 
still have been below the acceptable cut-off. 

The most interesting results are for Applicants B, C, 
and five expert systems made. (Detailed evaluations are 
contained in Appendix C.) Only two of the five experts 
agreed on the order in which they would select these 
"applicants" to be recruiters. 

A closer look at Table 13 and Appendix C provides some 
interesting insight into the selection problem. Based on 
their expert systems. Experts 2, 3, and 4 ranked Applicant D 
second. Expert 2's rating made Applicant D a superior 
choice, yet ratings by Experts 3 and 4 were below 60, and 
Expert 5 regarded Applicant D as minimally acceptable. 

Expert 1 ranked Applicant B second with an overall 
evaluation of 91.4 — clearly superior. Yet, two other 
experts rated the same applicant below 60, and Expert 3 
found Applicant B nearly minimally acceptable. 
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Although Expert 5 ranked Applicant C second, there was 
nearly a 40-point gap between Applicants E and C. The 
effects of the Standards Index came into play again here. 
Three experts ranked Applicant C third, but the evaluations 
ranged from 56 to 82.3. Expert l's lenient standards result 
in her fourth place choice being rated above all other 
experts' second place choices. 
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V. CONCLUSIONS AND RECOMMENDATIONS 



A. CONCLUSIONS 

1 . Past Research 

The goals of this thesis were to identify attributes 
associated with successful recruiters, develop and analyze a 
model to identify which attributes make the most valuable 
contributions to successful performance as a recruiter, and 
critique the applicability of existing data for this type of 
analysis . 



An extensive literature review identified many 
previous studies that examined the recruiter selection 
problem. Two distinct types of factors have been examined 
for their utility in predicting whether or not an individual 
would be a successful recruiter. One class of factors 
includes those for which information can be found in 
standard military personnel files. Many studies used 
traditional analytical methods such as regression analysis 
to determine whether recruiter productivity could be 
predicted by various combinations of factors. If these 
factors could be identified, they could be used to select 
for recruiting duty those individuals with the highest 
probability of success. The most frequently used personnel 
file type variables were age, gender, rank, education, 
entrance test scores, etc. 
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The other class of factors are given by specific 
tests to measure various personality characteristics. Past 
studies show that many researchers understood, at least 
intuitively, that successful recruiters possess some common 
personality characteristics. A wide variety of test 
batteries have been developed and used with varying amounts 
of success. 

Using either set of factors, the results were 
generally disappointing. Recruiter character istics found to 
be significant varied across studies, and no one reliable 
set of predictive character ist ics emerged from such data. 
When significant variables were identified, results either 
could not be duplicated upon cross-validation or were not 
cross-validated at all. Personnel data did not seem to 
contain information on the appropriate factors. Personality 
test factors often suffered from the presence of the 
criterion problem in the modeling efforts. 

The criterion problem, or measuring recruiter 
performance in a reliable and valid manner, was probably the 
single most important reason why past research explained 
relatively little variance in recruiter productivity. 
Researchers used various measures of performance as their 
dependent variable, such as supervisory ratings, school 
performance, percent of quota achieved, and total number of 
enlistments, only to find that each measure suffered from 
its own set of weaknesses. For example, although recruiter 
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production figures were easy to obtain and use, the measure 

was contaminated by market factors not related to individual 
recruiter productivity. Researchers have worked on this 
problem with some success, but more work is needed. 

The vast majority of military recruiters are not 
volunteers. Therefore, some researchers have argued that 
passive devices are needed to select individuals who are 
most likely to become successful recruiters. They advocate 
a shift away from "fakable" devices such as personality 
tests and favor the use of readily available biographical 
and background information. Recent work identified several 
characteristics that were related to recruiter productivity, 
but the results were not cross-validated. 

Relatively recent efforts by Borman and others have 
led to the development of a Special Assignment Battery 
designed especially for recruiter selection. The Battery 
predicted Navy recruiter performance fairly well and 
achieved similar success in a recent revalidation effort 
using Marine Corps recruiters. This approach appears to 
have significant promise. Its only apparent drawback are 
the costs its implementation would involve. 

2 . Expert Systems 

This thesis applied a "new" methodology to the 
recruiter selection problem. Referred to as Expert Systems, 
a field within the science of Artificial Intelligence (AI), 
this methodology has been used successfully to solve a wide 
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variety of problems, particularly those that require the 
types of judgmental decisions people make every day. Expert 
Systems use one or more experts' knowledge, judgments, 
experience, and intuition to solve problems. 

Expert System software called EXPERT87 was selected 
for this thesis. The program is based on a concept called 
QuasiArtif icial Intelligence (QAI), which successfully 
avoids some of the problems encountered in traditional AI 
applications. QAI is intended for the many types of 
moderately difficult and repetitive decisions managers and 
decision makers face. The method enables users to make 
coherent and objective decisions even when no known 
criterion or dependent variable is available for the 
development of an empirical model. 

3 . Profile of the Successful Recruiter 

The model developed for this thesis was based on 
those characteristics that previous studies had found to be 
related to recruiter success. These characteristics were 
arranged in a hierarchical structure. Attributes, or 
specific characteristics, were organized into larger 
dimensions, or branches, of the hierarchy. 

Five Army Recruiting experts evaluated the model, 
and EXPERT87 created their expert systems. A surprisingly 
consistent successful recruiter profile emerged. While the 
five expert systems differed in their relative weightings of 
attributes and dimensions, there was general agreement about 
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which characteristics were more important than others. Of 
the model's five dimensions. Personality Characteristics, 
Communications Skills, and Specific Experience were judged/ 
most important in a successful recruiter. Within those 
dimensions, the most important attributes were Integrity, 
Motivation, Listening, Informing, Sales Experience, 
Recruiting Experience, and Recruiter Training. 

B. RECOMMENDATIONS 

1 . Measure the Important Attributes 

These results may have important implications for 
future work in recruiter selection. Some researchers 
believe that improved formatting of the problem, better 
analytical techniques, and a more reliable dependent 
variable will improve the ability of traditional personnel 
data file variables (e.g., age, gender, rank, education, 
etc.) to predict recruiter performance. Yet, the results of 
this thesis found that these traditional variables 
contribute comparatively little to what the experts judged 
important in a successful recruiter. Characteristics that 
are usually not present in personnel data files appear to be 
much more important. Rather than investing much more time 
and effort using personnel file data to predict performance 
simply because the data exist, it may be more to the point 
to concentrate on finding ways to measure the attributes the 
experts judged to be relatively more important. 
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2 . Use Expert Systems 



Expert Systems can be applied to this problem and 
improve the quality of recruiter selection decisions. 
Significant numbers of experts exist who know what is 
required to be a successful recruiter. These individuals 
may or may not be consciously aware of the knowledge, 
experience, judgments, and intuition they possess that could 
be directed toward solutions. As is the case for most 
problems in the real world, there is no one right answer. 
The profile of the successful recruiter probably varies in 
many ways. While one set of attributes may be ideal for one 
particular market or environment, the same profile could 
lead to miserable results elsewhere. At the same time, some 
attributes may be universally important. Elicitation 
procedures such as Expert Systems can help recruiting 
managers decide which models fit best where, and why. 

3 . Improve the Model 

The model used in this thesis was a first attempt at 
representing knowledge about the recruiter selection problem 
in hierarchical form. The experts who participated in this 
project made many valuable suggestions for improvement. 
Specifically, adding two more dimensions, attributes that 
describe those dimensions, and separating the personality 
dimension may provide a model yielding even better insights 
to the relative importance of attributes for selecting 
successful recruiters. 
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Such a revised model might look something like the 
one pictured in Figure 5.1. The changes to the model in 
chapter two include: 

- Two new dimensions have been created. Sociological 
Characteristics and Military Background. 

- Two attributes. Time Management and Attention to Detail, 
have been added to the Administrative Skills dimension. 

- Attributes that describe behavior (What I do) have been 
separated from those that describe the ego (Who I am). 
This results in the replacement of the Personality 
Characteristics dimension with two new dimensions called 
Behavior and Ego. New attributes. Self-image and 
Self-starter, have been added. 

- Attributes within the Background Characteristics dimen- 
sion have been separated. 

Other improvements of the model could also be 
investigated. For example, military experience could be 
separated into Years of Active Duty and Years of Reserve 
Duty. One type of prior military experience may be more 
important than another, and it may be important to have 
relative weights for both types of experience. Geographic 
preference and military occupation may also be factors that 
are valuable in identifying potentially successful 
recruiters . 

4 . Work Remaining 

Many possible applications exist for this type of 
analysis and methodology. Expert Systems could be compared 
and contrasted across services to determine whether there 
are significant interservice differences in perceptions and 
knowledge of what characteristics are necessary for a 
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successful recruiter. As mentioned earlier. Expert Systems 
may be needed for different markets or recruiting 
environments within the U. S. Army Reserve. It may also be 
useful to develop Expert Systems for the Regular Army's 
recruiter selection problem. This may be particularly 
useful in light of the fact that such a high percentage of 
Regular Army recruiters (about 80 percent) are non- 
volunteers . 
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Figure 5.1 Profile of the Successful Recruiter: A Revised Model 
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THE EXPERT SYSTEMS: INDICES, VARIANCE, AND MEAN SQUARED ERROR 
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Fidelity Standards Discrimination Variance Squared 

EXPERT #3 Index Index Index Explained Error 
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Mean 

Squared 

Error 
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PROFILE OF THE SUCCESSFUL RECRUITER 
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APPENDIX C 



THE EXPERT SYSTEMS EVALUATE HYPOTHETICAL RECRUITER APPLICANTS 



Expert 

£ 



B 

C 



D 



A 



#1 



* * CONCEPTUAL LEVEL t * * 

CONCEPT = PROFILE OF THE SUCCESSFUL RECRUITER 



EXPERT 3 -t STEM = 




PRESS SPACE BAR 



* t t TOP LEVEL EVALUATION OF ALTERNATIVES * * * 
EVALUATION OF A. EXPERT SYSTEM = Expert #1 




OVERALL 



BELOW STANDARD 



50 - 



60 — 1 — 70 — 1 — 30 — 1 — 90 
SUPER PRESS SPACE BAR 
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f * t TOP LEVEL EVALUATION OF ALTERNATIVES t * t 

evaluation of e. expert system = Expert #1 



ADMINISTRATIVE Sk SH 

k I* <♦ ,«] .*< 



COMMUNICATION SK 




OVERALL 






-ir 4W. I{| Lj 



PI. 4 



10 Cm — — 3u— * — 4 0- 7 m . 0 0 — * — 90 

BELOW STANDARD SUPER PRESS SPACE BAR 



* * * TOP LEVEL EVALUATION OF ALTERNATIVES * t t 
EVALUATION OF C. EXPERT SYSTEM = Expert #1 

ADMINISTRATIVE SK IB 3 * 13 ffi 3 $$ « » JM !t| » «| 3 Ift ffl !« iS 3 tO !S B R 12 3RIUIS57. 3 



COMMUNICATION Sk 



BACKGROUND CHARA 



PERSONALITY CHAR 



SPECIFIC EXFERIEN 



OVERALL 




BELOW STANDARD SUFER FRE3S SPACE BAR 
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♦ * It TOP LEVEL EVALUATION OF ALTERNATIVES 
EVALUATION OF 0. EXPERT SYSTEM = EXDert #1 



ADMINISTRATIVE 3k 




* 




# * * TOP LEVEL EVALUATION OF ALTERNATIVES * * * 
EVALUATION OF E. EXPERT SYSTEM = Expert #1 
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< * 

SUCCESSFUL RECRUITER 



expert system 



Expert 

e 

D 

C 

B 

A 



* l * CONCEPTUAL LEVEL * 
„ ^ CONCEPT = PROFILE OF THE 
# 2 




PRESS SPACE BAR 



t t t TOP LEVEL EVALUATION OF ALTERNATIVES t t t 
EVALUATION OF A. EXPERT SYSTEM = EXDert #2 



ADMINISTRATIVE SK 
communication sk: 




6 




BELOW STANDARD 



50 — 1 — 60 — 1 — 70 — 1 — 80 — ‘ — 90 

SUPER PRESS SPACE SAR 
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* * * TOP LEVEL EVALUATION OF AL TERNA ! I Vb'j f * * 
EVALUAT I ON OF 8. EXPERT SYSTEM = Expert #2 



ADMINISTRATIVE SK 
COMMUNICATION Sk ! 
BACKGROUND CHARAit 
PERSONALITY CHApi 
SPECIFIC EXPERIEN 




OVERALL 






161.4 



1U — 1 — LU— ‘ — _>U — 1 

BELOW STANDARD 



aO — L— 70 
SURER 



— i — bo — i — 90 
PRESS SPACE BAR 



* * * TOP LEVEL EVALUATION OF ALTERNATIVES * * « 
EVALUATION OF C. EXPERT SYSTEM = Expert #2 



ADMINISTRATIVE SK 



COMMUNICATION SK 
BACKGROUND CHARa£ ajSIgp 




OVERALL 



- 1 — I v * ~u — vO — * — 40 
BELOW STANDARD 



Du ou — 1 — 70 — *— 3u — * — 90 

SURER PRESS SPACE BAR 
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* % t top 

EVALUATION OF D. 



LEVEL EVALUATION OF ALTERNATIVES 

expert system = Expert #2 



t 



ADMINISTRATIVE SK 
communication sk:: 
BACKGROUND CHARa! 
PERSONALITY CHArA 
SPECIFIC EXFERIeI 
OVERALL 




BELOW STANDARD 



SUPER PRESS SPACE BAR 



* * * TOP LEVEL EVALUATION OF ALTERNATIVES * * * 
EVALUATION OF E. EXPERT SYSTEM = Expert #2 



ADMINISTRATIVE SK 
COMMUNICATION SK,: 
BACKGROUND CHARaI 
PERSONALITY CHARa 
SPECIFIC EXPERIeI 
OVERALL 




— +■ — — — SO * 4*J — 1 — jO av , U — — zj j T*.» 



BELOW STANDARD SUPER PRESS SPACE BAR 
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t r f CONCEPTUAL LEVEL * * * 

Expert #3 carJCEPT = FR0FILE QF the successful recruiter expert system = 



E 



D 



C 



B 



A 



ISIIUllIIllilll 



-ilium 



UiSSilM 






> 1 - 32 . * 




-i— 10— ‘ — 20 — 1 — 30— 40 
BELOW STANDARD 



5U- 



60— » — 70— t— QO— »— 90 
SUPERIOR 



PRESS SPACE BAR 



* * * TOP LEVEL EVALUATION OF ALTERNATIVES « * < 
EVALUATION OF A. EXPERT SYSTEM = Expert #3 



ADMINISTRATIVE SK 

communication sk;: 

BACKGROUND CHARAC 
PERSONALITY CHAPA 

specific experie! 

OVERALL 




-4.0 




10— 20 — 1 — 30—1 — 
BELOW STANDARD 



40- 



60 — i — 70 — 1 — 00 — 1 — 90 
SUPER PRESS SPACE BAR 
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? f » i uR LEVEL EVhLUhI ION OF hL I LKNm I i Vbb * * * 

EVALUATION OF B. EXPERT SYSTEM ^Expert S3 



ADMINISTRATIVE SK 
COMMUNICATION SK t 
BACf GROUND CHARaI 
PERSONALITY CHARA 
SPECIFIC EXFERiel 
OVERALL 




* * * TOP LEVEL EVALUATION OF ALTERNATIVES * * * 
EVALUATION OF C. EXPERT SYSTEM = Expert #3 




BELOW STANDARD SUFER FRES3 SPACE BAR 
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t < * TOP LEVEL EVALUATION OF ALTERNATIVES * * t 

EVALUATION OF D. EXPERT SYSTEM = Expert #3 



ADMINISTRATIVE SK 



COMMUNICATION SK 



69 . 4 




SPECIFIC EXPERIEN agm 



OVERALL 



*ui- I £ *ni vT^'.' -r, . I 



1 •-» — ■ — —o — *- — ->U— — 4<J— *— — 60— > — 70— J — 30—1 — 90 

BELOW STANDARD SUPER PRESS SPACE BAR 



* * * TOP LEVEL EVALUATION OF ALTERNATIVES * * * 
EVALUATION OF E. EXPERT SYSTEM = Expert #3 



ADMINISTRATIVE SK 
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